00000001:02000400:0.0F:1789596517.094364:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789596538.886463:0:3522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789596541.211565:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 920 MB/s 00000001:01000000:2.0:1789596541.461387:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 819 MB/s 00000001:01000000:2.0:1789596541.710794:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4043 MB/s 00000020:02000000:2.0:1789596542.235994:0:3613:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g6aa67ea 00000400:02000000:3.0F:1789596543.145924:0:3628:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.116@tcp [8/256/0/180] 00008000:02000000:0.0:1789596546.567037:0:3778:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789596605.697507:0:5746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789596621.064540:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789596621.064547:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789596621.064548:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789596621.064729:0:6496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f3c57e92 00000080:02000400:0.0:1789596621.064740:0:6496:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789596621.077612:0:6496:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789596621.077628:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789596621.077663:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000dac1bb2) 00000020:00000080:0.0:1789596621.077725:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789596621.180465:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789596621.180567:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789596621.241402:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789596621.241727:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789596621.241735:0:6496:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789596621.241751:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe41f 00000020:01000004:3.0:1789596621.241758:0:6496:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789596621.241763:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789596621.241779:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f3c57e92 from MGS 00000020:01000004:3.0:1789596621.241783:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789596621.241802:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003a1cc6ae) 00000020:00000080:3.0:1789596621.241813:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789596621.241921:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f3c57e92 from MGS, refs=2 00080000:01000000:3.0:1789596621.241927:0:6496:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789596621.241933:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe42d 00000100:00100000:3.0:1789596621.247816:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789596621.248030:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789596621.248038:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789596621.249345:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789596621.249356:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789596621.250507:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596621.251172:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789596621.251181:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789596621.253659:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789596621.253673:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789596621.254363:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789596621.254372:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789596621.255191:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596621.255196:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596621.255197:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596621.255525:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596621.255528:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596621.255530:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596621.260894:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596621.261859:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000001:01000000:3.0:1789596621.511763:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2131 MB/s 00000001:01000000:0.0:1789596621.763809:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2412 MB/s 00000001:01000000:1.0F:1789596622.013845:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 491 MB/s 00000001:01000000:1.0:1789596622.264657:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 543 MB/s 00010000:00010000:2.0:1789596622.274233:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789596622.278540:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789596622.311982:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789596622.316806:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789596622.317294:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789596622.317360:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789596622.317619:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789596622.317659:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789596622.318209:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596622.318376:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789596622.318383:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789596622.319417:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789596622.319426:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789596622.324365:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789596622.324380:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789596622.332009:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789596622.332039:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:0.0:1789596622.332041:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789596622.332091:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:0.0:1789596622.332104:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (00000000fe437b79) 00000020:00000080:0.0:1789596622.332124:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789596622.332215:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002c0bf38b@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789596622.332432:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:0.0:1789596622.332438:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789596622.332956:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789596622.336427:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789596622.343015:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid d576172c-8178-43f9-add9-c496dd76058d) 00000020:00000080:0.0:1789596622.343050:0:6496:0:(genops.c:1384:class_connect()) connect: client d576172c-8178-43f9-add9-c496dd76058d, cookie 0x7b5398e289bbe43b 00000100:00080000:0.0:1789596622.343064:0:6496:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596622.343075:0:6496:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import 000000002c0bf38b using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596622.343122:0:6496:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007c6bfc9a x1876527984672896/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596622.343165:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d576172c-8178-43f9-add9-c496dd76058d->MGS 00000020:01000004:0.0:1789596622.343183:0:6496:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789596622.343189:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789596622.343205:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000908194cb) 00000020:00000080:0.0:1789596622.343219:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789596622.343958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c6bfc9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d576172c-8178-43f9-add9-c496dd76058d:3643:1876527984672896:0@lo:250: 00000100:00100000:1.0:1789596622.344212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.344403:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984672896 00000100:00100000:1.0:1789596622.344410:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984672896 00000100:00100000:1.0:1789596622.344449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596622.344455:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce00287e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876527984672896:12345-0@lo:250: 00010000:00080000:1.0:1789596622.344488:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d576172c-8178-43f9-add9-c496dd76058d@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1789596622.344511:0:6512:0:(genops.c:1384:class_connect()) connect: client d576172c-8178-43f9-add9-c496dd76058d, cookie 0x7b5398e289bbe449 00000100:00080000:1.0:1789596622.344819:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000bb30c9ab : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596622.344874:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce00287e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+5:3643:x1876527984672896:12345-0@lo:250: Request processed in 416us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.344882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596622.344929:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789596622.344937:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:1.0:1789596622.344944:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789596622.344949:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789596622.344951:0:3643:0:(import.c:65:import_set_state_nolock()) 000000002c0bf38b MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789596622.344954:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789596622.344965:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789596622.344969:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c6bfc9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d576172c-8178-43f9-add9-c496dd76058d:3643:1876527984672896:0@lo:250: 00000100:00100000:1.0:1789596622.372838:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596622.373163:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789596622.373170:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789596622.380793:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789596622.380808:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789596622.381510:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596622.381521:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789596622.384518:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596622.385332:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789596622.385340:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789596622.386174:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789596622.386183:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789596622.495162:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596622.495599:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789596622.495607:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789596622.497510:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789596622.497531:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789596622.499148:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596622.499525:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789596622.499531:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789596622.500582:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789596622.500603:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789596622.501622:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596622.503457:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789596622.503476:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789596622.504388:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789596622.504397:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789596622.505345:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596622.505524:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789596622.505529:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789596622.506355:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789596622.506362:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789596622.549641:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596622.551220:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789596622.551228:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789596622.561042:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789596622.561061:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789596622.563270:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596622.563282:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789596622.564748:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789596622.564782:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789596622.564789:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789596622.564901:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789596622.564938:0:6496:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789596622.564943:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789596622.564945:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789596622.564946:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596622.564947:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596622.564949:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596622.564950:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596622.564951:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789596622.564953:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789596622.564954:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596622.564955:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596622.564957:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596622.564958:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789596622.564960:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789596622.564963:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789596622.564964:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789596622.564970:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596622.564971:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596622.564972:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596622.564973:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596622.564974:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789596622.564975:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789596622.564976:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596622.564977:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596622.564978:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596622.564979:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789596622.565186:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789596622.565203:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b7aaee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673024:0@lo:253: 00000100:00100000:0.0:1789596622.565277:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.565394:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d5a8b93 going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.567096:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673024 00000100:00100000:1.0:1789596622.567109:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673024 00000100:00100000:1.0:1789596622.567164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596622.567173:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd165f47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+5:6496:x1876527984673024:12345-0@lo:253: 20000000:01000000:1.0:1789596622.567241:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789596622.567243:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789596622.573555:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789596622.573726:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789596622.574061:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596622.575844:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789596622.576317:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789596622.576322:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789596622.576329:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789596622.576332:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789596622.576345:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789596622.576562:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596622.577189:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789596622.577209:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789596622.577232:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789596622.577250:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789596622.577284:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789596622.577346:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789596622.577353:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789596622.577364:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789596622.577369:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789596622.577378:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789596622.577382:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789596622.577392:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789596622.577404:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789596622.577428:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789596622.577440:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789596622.577449:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596622.577597:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789596622.577607:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789596622.577622:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789596622.577652:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789596622.578452:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789596622.578479:0:6514:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789596622.578525:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789596622.578533:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789596622.578544:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789596622.578557:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789596622.578569:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789596622.578576:0:6514:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789596622.578595:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789596622.578601:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789596622.578613:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789596622.578655:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789596622.578746:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789596622.578767:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789596622.578774:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789596622.582909:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789596622.583230:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789596622.583257:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:1.0:1789596622.583260:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:1.0:1789596622.583276:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789596622.583281:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789596622.583292:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789596622.583296:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:1.0:1789596622.583307:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789596622.583315:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789596622.583327:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789596622.583341:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789596622.583369:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789596622.583372:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789596622.583376:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789596622.583455:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789596622.583458:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789596622.583986:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789596622.584195:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789596622.584217:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789596622.584232:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1789596622.584240:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789596622.584242:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789596622.585386:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789596622.585576:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789596622.585602:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789596622.585616:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789596622.585656:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789596622.585659:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789596622.585665:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789596622.585710:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789596622.585715:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789596622.585721:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789596622.586334:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789596622.586450:0:6514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789596622.606780:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789596622.606820:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789596622.606855:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789596622.606877:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789596622.606900:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606917:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606928:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606934:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606940:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606946:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606952:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071360e1b already unused, calling callback (00000000308788ce) 00010000:00010000:1.0:1789596622.606955:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606962:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606973:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606980:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.606995:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe450 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789596622.607016:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789596622.615101:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd165f47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+5:6496:x1876527984673024:12345-0@lo:253: Request processed in 47908us (49803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.615118:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596622.615270:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b7aaee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673024:0@lo:253: 10000000:01000000:3.0:1789596622.615285:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789596622.615289:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596622.615290:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596622.615292:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596622.615293:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789596622.615295:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596622.615296:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596622.615297:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596622.615299:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596622.615301:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789596622.615302:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596622.615304:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789596622.615324:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f3c57e92 from lustre-MDT0000 10000000:01000000:3.0:1789596622.615359:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789596622.615362:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789596622.615365:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c7e88948000 10000000:01000000:3.0:1789596622.615370:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596622.615377:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7e88948000 from 1 10000000:01000000:3.0:1789596622.615380:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789596622.615442:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.615453:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.615461:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596622.615488:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673152:0@lo:101: 00000100:00100000:3.0:1789596622.615532:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.615638:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2731945 going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.615731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673152 00000100:00100000:1.0:1789596622.615738:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673152 00000100:00100000:1.0:1789596622.615768:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596622.615776:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b09e858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+5:6496:x1876527984673152:12345-0@lo:101: 00010000:00010000:1.0:1789596622.615789:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596622.615800:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe457 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.615822:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.615832:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.615841:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000895cb348, rc 0) 00000100:00100000:1.0:1789596622.615880:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b09e858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+6:6496:x1876527984673152:12345-0@lo:101: Request processed in 105us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.615887:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596622.616113:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673152:0@lo:101: 00010000:00010000:3.0:1789596622.616125:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.616133:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596622.616194:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673280:0@lo:501: 00000100:00100000:3.0:1789596622.616219:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.616273:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673280 00000100:00100000:1.0:1789596622.616277:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673280 00000100:00100000:1.0:1789596622.616304:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596622.616317:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000628177fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+6:6496:x1876527984673280:12345-0@lo:501: 00000100:00100000:1.0:1789596622.616381:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000628177fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+6:6496:x1876527984673280:12345-0@lo:501: Request processed in 66us (163us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789596622.616388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596622.617111:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2731945 going to sleep for 11 seconds 00000100:00100000:3.0:1789596622.617131:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673280:0@lo:501: 10000000:01000000:3.0:1789596622.617161:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789596622.617176:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.617185:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596622.617192:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7e867d5800 10000000:01000000:3.0:1789596622.617198:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789596622.617201:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7e867d5800 10000000:01000000:3.0:1789596622.617204:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789596622.617206:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7e867d5800 from 1 10000000:01000000:3.0:1789596622.617208:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789596622.617227:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.617234:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.617255:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596622.617268:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673408:0@lo:101: 00000100:00100000:3.0:1789596622.617299:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.617488:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2731945 going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.617930:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673408 00000100:00100000:1.0:1789596622.617936:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673408 00000100:00100000:2.0:1789596622.618154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596622.618163:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009bdb661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+6:6496:x1876527984673408:12345-0@lo:101: 00010000:00010000:2.0:1789596622.618174:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596622.618187:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b9a7845/0x7b5398e289bbe46c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe465 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.618206:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b9a7845/0x7b5398e289bbe46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe465 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.618214:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b9a7845/0x7b5398e289bbe46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe465 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.618222:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b9a7845, rc 0) 00000100:00100000:2.0:1789596622.618283:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009bdb661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+7:6496:x1876527984673408:12345-0@lo:101: Request processed in 122us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596622.618294:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596622.618379:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673408:0@lo:101: 00010000:00010000:3.0:1789596622.618390:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.618398:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596622.618410:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789596622.618427:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.618433:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000fcfd27ae/0x7b5398e289bbe465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596622.618439:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789596622.618443:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596622.618447:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7e867d5800 10000000:01000000:3.0:1789596622.618451:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789596622.618454:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789596622.618456:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789596622.618483:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.618497:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.618505:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596622.618518:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673536:0@lo:101: 00000100:00100000:3.0:1789596622.618548:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.618903:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2731945 going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.619095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673536 00000100:00100000:1.0:1789596622.619101:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673536 00000100:00100000:1.0:1789596622.619131:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596622.619139:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe7f1ff6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+7:6496:x1876527984673536:12345-0@lo:101: 00010000:00010000:1.0:1789596622.619148:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596622.619158:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe473 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.619174:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.619181:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.619188:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7cb7a05, rc 0) 00000100:00100000:1.0:1789596622.619222:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe7f1ff6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+8:6496:x1876527984673536:12345-0@lo:101: Request processed in 85us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.619227:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596622.619314:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673536:0@lo:101: 00010000:00010000:3.0:1789596622.619325:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.619332:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596622.619460:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673664:0@lo:501: 00000100:00100000:3.0:1789596622.619525:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.619551:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2731945 going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.620083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673664 00000100:00100000:1.0:1789596622.620089:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673664 00000100:00100000:1.0:1789596622.620112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596622.620116:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001081d5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+8:6496:x1876527984673664:12345-0@lo:501: 00000100:00100000:1.0:1789596622.620231:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001081d5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+9:6496:x1876527984673664:12345-0@lo:501: Request processed in 115us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.620249:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596622.621835:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673664:0@lo:501: 00000100:00100000:3.0:1789596622.621911:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673792:0@lo:503: 00000100:00100000:3.0:1789596622.621988:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.622178:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2731945 going to sleep for 11 seconds 00000100:00100000:2.0:1789596622.623591:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673792 00000100:00100000:2.0:1789596622.623604:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673792 00000100:00100000:1.0:1789596622.623725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596622.625888:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fa443a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+9:6496:x1876527984673792:12345-0@lo:503: 00000100:00100000:3.0:1789596622.626226:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fa443a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+9:6496:x1876527984673792:12345-0@lo:503: Request processed in 2492us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596622.626244:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596622.626266:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006280ad97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984673792:0@lo:503: 00000100:00100000:3.0:1789596622.627131:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000874a998a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6541:1876527984673920:0@lo:502: 00000100:00100000:3.0:1789596622.627180:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.627215:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984673920 00000100:00100000:3.0:1789596622.627224:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 00000000427fde4d going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.627228:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984673920 00000100:00100000:0.0:1789596622.627266:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596622.627274:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000046ca5b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+9:6541:x1876527984673920:12345-0@lo:502: 00000100:00100000:0.0:1789596622.627383:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000046ca5b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+9:6541:x1876527984673920:12345-0@lo:502: Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.627391:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596622.627491:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000874a998a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6541:1876527984673920:0@lo:502: 00000020:01000000:3.0:1789596622.627516:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596622.627527:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596622.627529:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789596622.627534:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789596622.627538:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596622.627552:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ec97ea48) 00000020:00000080:3.0:1789596622.627572:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789596622.627579:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789596622.627666:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789596622.627674:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe488 00000020:00000080:3.0:1789596622.627980:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789596622.627985:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596622.627988:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596622.627999:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789596622.628002:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596622.628006:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596622.628008:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789596622.628011:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596622.628017:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007bd631a0) 00000020:00000080:3.0:1789596622.628027:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789596622.628031:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789596622.628033:0:6541:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789596622.628035:0:6541:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789596622.628041:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789596622.628108:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f3c57e92 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789596622.628123:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ef935ad0) 00000020:00000080:3.0:1789596622.628128:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789596622.628180:0:6541:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789596622.628184:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe49d 00000020:00000080:3.0:1789596622.628255:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789596622.628260:0:6541:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789596622.628262:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7b5398e289bbe4a4 00080000:01000000:3.0:1789596622.628266:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789596622.628267:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe4ab 00080000:10000000:3.0:1789596622.628790:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789596622.628928:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789596622.633600:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789596622.710291:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789596622.713175:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789596622.717060:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789596622.717507:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789596622.720964:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000498af835) 00000020:00000080:3.0:1789596622.721003:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789596622.721095:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789596622.721102:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe4b9 00000020:00000080:0.0:1789596622.722059:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789596622.723307:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789596622.741585:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.746788:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.750272:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.753288:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.756185:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789596622.759288:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7b5398e289bbe4c0 00000020:00000080:2.0:1789596622.759573:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789596622.759585:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596622.759591:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596622.759594:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789596622.759596:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596622.759601:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596622.759602:0:6541:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596622.759605:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596622.759607:0:6541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789596622.759609:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596622.759611:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596622.759612:0:6541:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789596622.759614:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596622.759619:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596622.759620:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789596622.759636:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789596622.759723:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789596622.759792:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31e6c9f pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6541:1876527984674048:0@lo:502: 00000100:00100000:2.0:1789596622.759889:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596622.759937:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 00000000692a6e90 going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.760199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674048 00000100:00100000:0.0:1789596622.760208:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674048 00000100:00100000:0.0:1789596622.760246:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596622.760254:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000679e96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+9:6541:x1876527984674048:12345-0@lo:502: 00000100:00100000:0.0:1789596622.760381:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000679e96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+9:6541:x1876527984674048:12345-0@lo:502: Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.760389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789596622.760498:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31e6c9f pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6541:1876527984674048:0@lo:502: 00000020:01000000:3.0:1789596622.760526:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596622.760532:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596622.760533:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789596622.760537:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789596622.761281:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789596622.761308:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789596622.761331:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.761343:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596622.761351:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7e867d5800 from 1 10000000:01000000:0.0:1789596622.761361:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596622.761389:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.761397:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.761405:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596622.761420:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053135e37 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674176:0@lo:101: 00000100:00100000:0.0:1789596622.761459:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.761504:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e72eeaef going to sleep for 11 seconds 00000100:00100000:3.0:1789596622.761609:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674176 00000100:00100000:3.0:1789596622.761615:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674176 00000100:00100000:3.0:1789596622.761652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596622.761659:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d734595b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+9:6496:x1876527984674176:12345-0@lo:101: 00010000:00010000:3.0:1789596622.761709:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596622.761724:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe4c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.761753:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.761762:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.761770:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012c36185, rc 0) 00000100:00100000:3.0:1789596622.761805:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d734595b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+10:6496:x1876527984674176:12345-0@lo:101: Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596622.761811:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596622.762011:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053135e37 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674176:0@lo:101: 00010000:00010000:2.0:1789596622.762026:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.762034:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596622.762567:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac4b0582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674304:0@lo:256: 00000100:00100000:2.0:1789596622.762610:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596622.762644:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a10db1e going to sleep for 11 seconds 00000100:00100000:3.0:1789596622.762820:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674304 00000100:00100000:3.0:1789596622.762826:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674304 00000100:00100000:3.0:1789596622.762850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596622.762855:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd2121a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+10:6496:x1876527984674304:12345-0@lo:256: 20000000:01000000:3.0:1789596622.763044:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789596622.763052:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789596622.763120:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd2121a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+10:6496:x1876527984674304:12345-0@lo:256: Request processed in 265us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596622.763128:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596622.763316:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac4b0582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674304:0@lo:256: 10000000:01000000:2.0:1789596622.765055:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596622.765081:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.765095:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596622.765232:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e867d5800 from 1 10000000:01000000:3.0:1789596622.765236:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596622.765304:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.765311:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.765321:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596622.765350:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000874a998a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674432:0@lo:101: 00000100:00100000:3.0:1789596622.765415:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.765497:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000038876f9 going to sleep for 11 seconds 00000100:00100000:2.0:1789596622.765537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674432 00000100:00100000:2.0:1789596622.765545:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674432 00000100:00100000:2.0:1789596622.765639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789596622.765649:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009dcfa9e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+10:6496:x1876527984674432:12345-0@lo:101: 00010000:00010000:2.0:1789596622.765674:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596622.765724:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe4d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.765748:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.765758:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.765766:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002993969, rc 0) 00000100:00100000:2.0:1789596622.765815:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009dcfa9e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+11:6496:x1876527984674432:12345-0@lo:101: Request processed in 167us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596622.766517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596622.766921:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000874a998a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674432:0@lo:101: 00010000:00010000:1.0:1789596622.766940:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.766950:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596622.767060:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f979f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674560:0@lo:501: 00000100:00100000:1.0:1789596622.767108:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.767627:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000005294e913 going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.767826:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674560 00000100:00100000:0.0:1789596622.767833:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674560 00000100:00100000:0.0:1789596622.767882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596622.767890:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000566e0cec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:6496:x1876527984674560:12345-0@lo:501: 00000100:00100000:0.0:1789596622.768095:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000566e0cec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:6496:x1876527984674560:12345-0@lo:501: Request processed in 206us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.768102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596622.768229:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f979f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674560:0@lo:501: 00000100:00100000:1.0:1789596622.768267:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f979f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674688:0@lo:503: 00000100:00100000:1.0:1789596622.768308:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.768336:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000005294e913 going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.768854:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674688 00000100:00100000:0.0:1789596622.768861:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674688 00000100:00100000:0.0:1789596622.768902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596622.768907:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000ccca20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:6496:x1876527984674688:12345-0@lo:503: 00000040:00080000:0.0:1789596622.768947:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789596622.769007:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000ccca20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:6496:x1876527984674688:12345-0@lo:503: Request processed in 100us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.769014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596622.769154:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f979f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674688:0@lo:503: 00000040:00080000:1.0:1789596622.770226:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789596622.770863:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789596622.770964:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596622.771033:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.771047:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596622.771112:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789596622.771115:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7e867d5800 10000000:01000000:0.0:1789596622.771118:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7e867d5800 10000000:01000000:0.0:1789596622.771121:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789596622.771127:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e867d5800 from 1 10000000:01000000:0.0:1789596622.771130:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596622.771166:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.771173:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.771183:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596622.771205:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674816:0@lo:101: 00000100:00100000:0.0:1789596622.771271:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.771316:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6ca487e going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.771497:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674816 00000100:00100000:1.0:1789596622.771504:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674816 00000100:00100000:1.0:1789596622.771540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596622.771547:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000781e3e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:6496:x1876527984674816:12345-0@lo:101: 00010000:00010000:1.0:1789596622.771560:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596622.771573:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe4e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.771611:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.771622:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.771643:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071360e1b, rc 0) 00000100:00100000:1.0:1789596622.771723:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000781e3e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984674816:12345-0@lo:101: Request processed in 175us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.771730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596622.771979:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674816:0@lo:101: 00010000:00010000:0.0:1789596622.772052:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.772060:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596622.772119:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674944:0@lo:501: 00000100:00100000:0.0:1789596622.772143:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.772164:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6ca487e going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.772214:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984674944 00000100:00100000:1.0:1789596622.772218:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984674944 00000100:00100000:1.0:1789596622.772237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789596622.772243:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c364782 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984674944:12345-0@lo:501: 00000100:00100000:1.0:1789596622.772367:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c364782 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984674944:12345-0@lo:501: Request processed in 124us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.772374:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596622.772437:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984674944:0@lo:501: 00000100:00100000:0.0:1789596622.772463:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984675072:0@lo:503: 00000100:00100000:0.0:1789596622.772509:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.772537:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6ca487e going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.772578:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675072 00000100:00100000:1.0:1789596622.772582:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675072 00000100:00100000:1.0:1789596622.772597:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596622.772602:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d8df647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984675072:12345-0@lo:503: 00000100:00100000:0.0:1789596622.772980:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d8df647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984675072:12345-0@lo:503: Request processed in 376us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.772987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596622.773041:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984675072:0@lo:503: 00000100:00100000:1.0:1789596622.773501:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f979f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6546:1876527984675200:0@lo:502: 00000100:00100000:1.0:1789596622.773544:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.773575:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084f0d2cf going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.773618:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675200 00000100:00100000:0.0:1789596622.773967:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675200 00000100:00100000:0.0:1789596622.774016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596622.774023:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d25aef49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6546:x1876527984675200:12345-0@lo:502: 00000100:00100000:0.0:1789596622.774140:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d25aef49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6546:x1876527984675200:12345-0@lo:502: Request processed in 116us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.774147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596622.774193:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f979f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6546:1876527984675200:0@lo:502: 00000020:01000004:0.0:1789596622.774253:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789596622.774269:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d889241a) 00000020:00000080:0.0:1789596622.774288:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789596622.774378:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f3c57e92 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789596622.774382:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f3c57e92 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789596622.774390:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f3c57e92 4 00010000:00080000:0.0:1789596622.774417:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007372423c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789596622.777403:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789596622.777657:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789596622.777727:0:6546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789596622.777739:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7b5398e289bbe4f8 00000100:00080000:0.0:1789596622.777749:0:6546:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596622.777759:0:6546:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007372423c using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596622.777794:0:6546:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc807855 x1876527984675328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596622.777864:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984675328:0@lo:38: 00000100:00100000:2.0:1789596622.777946:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.778150:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675328 00000100:00100000:0.0:1789596622.778158:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675328 00000100:00100000:0.0:1789596622.778191:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596622.778196:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac4b0582 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984675328:12345-0@lo:38: 00000100:00080000:1.0:1789596622.778971:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789596622.782817:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac4b0582 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984675328:12345-0@lo:38: Request processed in 4612us (4864us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789596622.782833:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596622.783921:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095f31db0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6546:1876527984675456:0@lo:502: 00000100:00100000:1.0:1789596622.784192:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.784241:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 000000003461a233 going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.784292:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675456 00000100:00100000:0.0:1789596622.784299:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675456 00000100:00100000:0.0:1789596622.784345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596622.784352:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a5a21a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+12:6546:x1876527984675456:12345-0@lo:502: 00000100:00100000:0.0:1789596622.784460:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a5a21a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+12:6546:x1876527984675456:12345-0@lo:502: Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596622.784480:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596622.784534:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095f31db0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:6546:1876527984675456:0@lo:502: 00000040:00080000:0.0:1789596622.784559:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789596622.784618:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789596622.784641:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596622.784700:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.784711:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789596622.784764:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789596622.784766:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789596622.784767:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596622.784768:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596622.784769:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596622.784770:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596622.784771:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789596622.784773:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789596622.784774:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596622.784775:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596622.784776:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596622.784778:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789596622.784781:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789596622.784783:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789596622.784785:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789596622.784785:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596622.784786:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596622.784787:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596622.784788:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596622.784789:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789596622.784790:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789596622.784791:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596622.784791:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596622.784792:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596622.784793:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789596622.784807:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789596622.784815:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c522205 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984675584:0@lo:253: 00000100:00100000:0.0:1789596622.784846:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596622.784878:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e55f254d going to sleep for 11 seconds 00000100:00100000:1.0:1789596622.785144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675584 00000100:00100000:1.0:1789596622.785149:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675584 00000100:00100000:1.0:1789596622.785183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789596622.785191:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a7d9585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984675584:12345-0@lo:253: 20000000:01000000:1.0:1789596622.785213:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789596622.785226:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789596622.786981:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596622.787066:0:3643:0:(import.c:65:import_set_state_nolock()) 000000007372423c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596622.787075:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789596622.787080:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc807855 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984675328:0@lo:38: 20000000:01000000:2.0:1789596622.790444:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789596622.790473:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789596622.790613:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789596622.790618:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789596622.790653:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.790697:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.790705:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.790739:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.790752:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596622.790765:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984675712:0@lo:104: 00000100:00100000:0.0:1789596622.790829:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.790975:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675712 00000100:00100000:1.0:1789596622.790984:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675712 00000100:00100000:1.0:1789596622.791037:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596622.791043:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060159d7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984675712:12345-0@lo:104: 00010000:00010000:1.0:1789596622.791055:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596622.791107:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596622.791112:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060159d7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984675712:12345-0@lo:104: Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.791118:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596622.791295:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a213c60c going to sleep for 11 seconds 00000100:00100000:0.0:1789596622.791316:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984675712:0@lo:104: 00010000:00010000:0.0:1789596622.791330:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596622.791450:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a7d9585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6496:x1876527984675584:12345-0@lo:253: Request processed in 6261us (6603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596622.791457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596622.791544:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c522205 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:6496:1876527984675584:0@lo:253: 10000000:01000000:0.0:1789596622.791557:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789596622.791560:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789596622.791562:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789596622.791563:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596622.791565:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596622.791566:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596622.791567:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596622.791568:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789596622.791569:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789596622.791580:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596622.791581:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596622.791583:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596622.791584:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789596622.791594:0:6496:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789596622.794622:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596622.794644:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.794658:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a4712ff already unused, calling callback (0000000042805882) 10000000:00010000:3.0:1789596622.794662:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.794704:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596622.794711:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596622.794718:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596622.794768:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.794775:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596622.794797:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.794804:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe4c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596622.794824:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596622.794842:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596622.794844:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596622.794934:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596622.794953:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000499956b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984675840:0@lo:103: 00000100:00100000:3.0:1789596622.795036:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596622.798898:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675840 00000100:00100000:2.0:1789596622.798916:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675840 00010000:00010000:2.0:1789596622.798952:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596622.798995:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596622.799005:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5ca562 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+12:3644:x1876527984675840:12345-0@lo:103: 00010000:00010000:2.0:1789596622.799021:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596622.799026:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799061:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799079:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012c36185/0x7b5398e289bbe4ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe4c7 expref: 12 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799116:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799149:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596622.799168:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008550985s 00010000:00010000:2.0:1789596622.799210:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799230:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799236:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799242:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799249:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efc1aba5 already unused, calling callback (00000000308788ce) 00010000:00010000:2.0:1789596622.799252:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799259:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799285:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596622.799296:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596622.799380:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5ca562 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+11:3644:x1876527984675840:12345-0@lo:103: Request processed in 377us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596622.799397:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596622.799449:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000499956b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984675840:0@lo:103: 00010000:00010000:0.0:1789596622.800283:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.800296:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596622.800301:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe4ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789596622.802161:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.802384:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789596622.803210:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.803376:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789596622.804139:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.804302:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789596622.806423:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.806613:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789596622.806882:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.807351:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789596622.807861:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789596622.808225:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789596622.813949:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789596622.824361:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789596622.824858:0:6551:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789596622.824863:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789596622.825054:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1789596622.827506:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789596622.831483:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789596622.831621:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789596622.832328:0:6496:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789596622.832338:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789596622.832508:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596622.835150:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:2.0:1789596622.835165:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:1.0:1789596622.835225:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789596622.835230:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789596622.836133:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789596622.836184:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789596622.836495:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789596622.837157:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1789596622.838344:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789596622.838539:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789596622.838836:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789596622.839107:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789596622.839202:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789596622.839307:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789596622.839516:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789596622.839616:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789596622.839956:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789596622.840106:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789596622.840212:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789596622.840321:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789596622.840516:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789596622.840602:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789596622.841104:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789596622.841249:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789596622.841552:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789596622.841813:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789596622.842042:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789596622.842175:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789596622.842310:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789596622.842529:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789596622.842960:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789596622.843114:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789596622.843201:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789596622.843314:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789596622.843524:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789596622.843608:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789596622.843950:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789596622.844121:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789596622.844239:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789596622.844335:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789596622.844629:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789596622.848336:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789596622.848380:0:6496:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0dc41c73988 00100000:10000000:2.0:1789596622.848451:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789596622.849257:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789596622.849274:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789596622.849297:0:6496:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789596622.849328:0:6496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789596622.850011:0:6496:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596622.850220:0:6496:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789596623.296165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596624.317206:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596625.341932:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596626.364987:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596627.389376:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596627.900841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789596627.900862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789596627.900865:0:37:0:(import.c:65:import_set_state_nolock()) 000000007372423c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789596627.900891:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007372423c using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596627.900915:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075968194 x1876527984676096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596627.900956:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984676096:0@lo:38: 00000100:00100000:0.0:1789596627.901030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596627.901112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676096 00000100:00100000:0.0:1789596627.901120:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676096 00000100:00100000:0.0:1789596627.901156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596627.901162:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001524ccf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984676096:12345-0@lo:38: 00010000:00080000:0.0:1789596627.901188:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1789596627.901244:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7b5398e289bbe506 00000004:00100000:0.0:1789596627.901295:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789596627.901459:0:6521:0:(import.c:65:import_set_state_nolock()) 00000000c8a84216 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596627.901514:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001524ccf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876527984676096:12345-0@lo:38: Request processed in 351us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596627.901521:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789596627.901645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000075968194 x1876527984676096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596627.901661:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789596627.901667:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789596627.901705:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789596627.901707:0:3643:0:(import.c:65:import_set_state_nolock()) 000000007372423c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596627.901713:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984676096:0@lo:38: 00000100:00100000:3.0:1789596627.901981:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c522205 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984675968:0@lo:400: 00000100:00100000:3.0:1789596627.902019:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596627.902270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984675968 00000100:00100000:0.0:1789596627.902276:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984675968 00000100:00100000:0.0:1789596627.902316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789596627.902323:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ab1955b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+11:3646:x1876527984675968:12345-0@lo:400: 00000100:00100000:0.0:1789596627.902364:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ab1955b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+11:3646:x1876527984675968:12345-0@lo:400: Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596627.902370:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789596627.902463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c522205 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984675968:0@lo:400: 00010000:00010000:0.0:1789596628.428003:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596628.450512:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789596629.443700:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789596629.625228:0:6849:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596629.625481:0:6849:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789596630.467872:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789596630.467881:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7e867d5800 from 3 10000000:01000000:3.0:1789596630.467885:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789596630.467943:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596630.467956:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596630.467968:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596630.467992:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b92c79a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984676224:0@lo:101: 00000100:00100000:3.0:1789596630.468072:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596630.468124:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000738a576f going to sleep for 11 seconds 00000100:00100000:2.0:1789596630.468420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676224 00000100:00100000:2.0:1789596630.468428:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676224 00000100:00100000:2.0:1789596630.468483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596630.468492:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e966d2e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:6517:x1876527984676224:12345-0@lo:101: 00010000:00010000:2.0:1789596630.468512:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596630.468527:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe50d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596630.468552:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596630.468562:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596630.468571:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b9a59bf, rc 0) 00000100:00100000:2.0:1789596630.468615:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e966d2e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:6517:x1876527984676224:12345-0@lo:101: Request processed in 124us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596630.468622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596630.468670:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b92c79a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984676224:0@lo:101: 00010000:00010000:2.0:1789596630.468704:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596630.468714:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596630.468762:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ce48a73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984676352:0@lo:256: 00000100:00100000:2.0:1789596630.468796:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596630.468811:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000005134f30c going to sleep for 11 seconds 00000100:00100000:2.0:1789596630.468824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676352 00000100:00100000:2.0:1789596630.468828:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676352 00000100:00100000:2.0:1789596630.468850:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596630.468856:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a369ff2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+12:6517:x1876527984676352:12345-0@lo:256: 20000000:01000000:2.0:1789596630.468880:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789596630.468897:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789596630.468900:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789596630.468984:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a369ff2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+12:6517:x1876527984676352:12345-0@lo:256: Request processed in 128us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596630.468991:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596630.469020:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ce48a73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984676352:0@lo:256: 10000000:01000000:2.0:1789596630.469058:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596630.469064:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596630.469071:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596630.469407:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596631.487458:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596632.511809:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789596632.614890:0:6951:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596632.615274:0:6951:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789596633.021302:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081e6b0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984676480:0@lo:400: 00000100:00100000:2.0:1789596633.021437:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.021525:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596633.021532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad31810a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984676608:0@lo:400: 00000100:00100000:2.0:1789596633.021562:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.021764:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676608 00000100:00100000:0.0:1789596633.021773:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676608 00000100:00100000:0.0:1789596633.021832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596633.021840:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ce48a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984676608:12345-0@lo:400: 00000100:00100000:0.0:1789596633.021895:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ce48a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984676608:12345-0@lo:400: Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596633.021902:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789596633.022097:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ad31810a x1876527984676608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596633.022112:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad31810a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984676608:0@lo:400: 00000100:00100000:1.0:1789596633.022177:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676480 00000100:00100000:1.0:1789596633.022182:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676480 00000100:00100000:1.0:1789596633.022214:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789596633.022233:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ea7cda3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+12:3647:x1876527984676480:12345-0@lo:400: 00000100:00100000:1.0:1789596633.022276:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ea7cda3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+12:3647:x1876527984676480:12345-0@lo:400: Request processed in 43us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.022281:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596633.022362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081e6b0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984676480:0@lo:400: 00010000:00010000:3.0:1789596633.533999:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596634.560111:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596635.580904:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596636.605234:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596637.629458:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596638.144530:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596638.144557:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984676736:0@lo:400: 00000100:00100000:0.0:1789596638.144631:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596638.144715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000773a5b5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984676864:0@lo:400: 00000100:00100000:0.0:1789596638.144742:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596638.144794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676736 00000100:00100000:0.0:1789596638.144803:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676736 00000100:00100000:0.0:1789596638.144847:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596638.144855:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f56fd618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+12:3644:x1876527984676736:12345-0@lo:400: 00000100:00100000:0.0:1789596638.144901:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f56fd618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+12:3644:x1876527984676736:12345-0@lo:400: Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596638.144908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596638.144941:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676864 00000100:00100000:0.0:1789596638.144945:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676864 00000100:00100000:0.0:1789596638.144967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596638.144972:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094e154c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984676864:12345-0@lo:400: 00000100:00100000:0.0:1789596638.145006:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094e154c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984676864:12345-0@lo:400: Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596638.145012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789596638.145043:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000773a5b5c x1876527984676864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596638.145057:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000773a5b5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984676864:0@lo:400: 00000100:00100000:0.0:1789596638.145077:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984676736:0@lo:400: 00010000:00010000:1.0:1789596638.653066:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596639.676916:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596640.706348:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596641.728005:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596642.751880:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789596642.863898:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789596642.863903:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789596642.863904:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789596642.864047:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d0bed55e 00000020:01000004:3.0:1789596642.864657:0:7449:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1789596642.864671:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789596642.864704:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e347eeea) 00000020:00000080:3.0:1789596642.864885:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789596642.974037:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789596642.974120:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789596643.014200:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789596643.014427:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789596643.014438:0:7449:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789596643.014450:0:7449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbe522 00000020:01000004:0.0:1789596643.014457:0:7449:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789596643.014479:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789596643.014482:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789596643.014488:0:7449:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789596643.014526:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789596643.014530:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789596643.045017:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596643.045064:0:7449:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789596643.045068:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596643.045070:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789596643.045071:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596643.045077:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596643.045078:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596643.045079:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596643.045080:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596643.045081:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596643.045083:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596643.045084:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596643.045085:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596643.045089:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789596643.045091:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596643.045092:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789596643.045093:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596643.045094:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596643.045095:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596643.045096:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596643.045097:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596643.045098:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596643.045098:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596643.045099:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596643.045100:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596643.045127:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789596643.045145:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984676992:0@lo:253: 00000100:00100000:2.0:1789596643.045229:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.045300:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcfaff25 going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.045312:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984676992 00000100:00100000:0.0:1789596643.045322:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984676992 00000100:00100000:0.0:1789596643.045381:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596643.045389:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2fb481d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:7449:x1876527984676992:12345-0@lo:253: 20000000:01000000:0.0:1789596643.045429:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789596643.045434:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789596643.045438:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789596643.045441:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789596643.045473:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789596643.045642:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596643.045786:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789596643.045798:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789596643.045825:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789596643.045838:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789596643.045849:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789596643.045903:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789596643.045911:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789596643.045921:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789596643.045925:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789596643.045935:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789596643.045938:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789596643.045948:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789596643.045959:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789596643.046036:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789596643.046043:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789596643.046053:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789596643.046057:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789596643.046066:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789596643.046070:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789596643.046088:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789596643.046093:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789596643.046102:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789596643.046114:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789596643.046121:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789596643.046181:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789596643.046188:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789596643.046198:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789596643.046210:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789596643.046223:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789596643.046227:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789596643.046247:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789596643.046263:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789596643.046267:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789596643.046298:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789596643.046304:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789596643.049851:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789596643.050160:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789596643.050192:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:0.0:1789596643.050195:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789596643.050213:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789596643.050219:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789596643.050232:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789596643.050238:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789596643.050256:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789596643.050265:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789596643.050293:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789596643.050310:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789596643.050358:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789596643.050367:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789596643.050943:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789596643.051106:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789596643.051141:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:0.0:1789596643.051143:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789596643.051159:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789596643.051165:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789596643.051176:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789596643.051181:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789596643.051191:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789596643.051196:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789596643.051207:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789596643.051222:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789596643.051240:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789596643.051243:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789596643.051247:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789596643.051309:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789596643.051312:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789596643.051907:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789596643.051936:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789596643.051953:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789596643.052105:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789596643.052126:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789596643.052144:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789596643.052154:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789596643.052156:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789596643.052400:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789596643.052418:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789596643.052432:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789596643.052902:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789596643.052919:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789596643.052939:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789596643.052947:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789596643.052954:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596643.053201:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596643.053217:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596643.053228:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789596643.053382:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789596643.053403:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789596643.053419:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789596643.053432:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789596643.053435:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789596643.053499:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789596643.053506:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789596643.062204:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789596643.064423:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789596643.078403:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789596643.078435:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078455:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078461:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078489:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078495:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078539:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078553:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 12 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.078565:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000033935ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984677120:0@lo:104: 00000100:00100000:3.0:1789596643.078634:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596643.078778:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.078785:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 12 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.078792:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5741b59 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984677248:0@lo:104: 00000100:00100000:3.0:1789596643.079128:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596643.087043:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.087064:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 12 pid: 6513 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.087078:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984677376:0@lo:104: 00000100:00100000:3.0:1789596643.087152:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.091111:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677120 00000100:00100000:1.0:1789596643.091129:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677120 00000100:00100000:1.0:1789596643.091192:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677248 00000100:00100000:1.0:1789596643.091196:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677248 00000100:00100000:1.0:1789596643.091215:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596643.091222:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017e2168b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6514:x1876527984677120:12345-0@lo:104: 00010000:00010000:1.0:1789596643.091239:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091358:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596643.091364:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017e2168b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6514:x1876527984677120:12345-0@lo:104: Request processed in 143us (12730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.091371:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596643.091389:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596643.091394:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e02d4132 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984677248:12345-0@lo:104: 00010000:00010000:1.0:1789596643.091402:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091441:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789596643.091445:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e02d4132 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984677248:12345-0@lo:104: Request processed in 52us (12318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.091450:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789596643.091472:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596643.091478:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091482:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596643.091486:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071f11f56 already unused, calling callback (0000000042805882) 10000000:00010000:2.0:1789596643.091490:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.091497:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596643.091503:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596643.091509:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596643.091544:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.091551:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596643.091566:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.091581:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe4e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.091613:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.091614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.091616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.091673:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.091675:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.091690:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596643.091719:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091726:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000095f3279b already unused, calling callback (0000000042805882) 10000000:00010000:1.0:1789596643.091728:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091733:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596643.091738:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596643.091743:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596643.091757:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091763:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596643.091785:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.091791:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 0000000095f3279b/0x7b5398e289bbe473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe47a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.091828:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057604144 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984677632:0@lo:103: 00000100:00100000:2.0:1789596643.091870:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596643.091870:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596643.091872:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596643.091873:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596643.091917:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677632 00000100:00100000:2.0:1789596643.091922:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677632 00010000:00010000:2.0:1789596643.091942:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 13 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.091963:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596643.091969:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000185154a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+13:3644:x1876527984677632:12345-0@lo:103: 00010000:00010000:2.0:1789596643.091978:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596643.091982:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 13 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.091991:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 13 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.092006:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596643.092029:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000185154a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+13:3644:x1876527984677632:12345-0@lo:103: Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.092045:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596643.092077:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057604144 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984677632:0@lo:103: 00000100:00100000:1.0:1789596643.093051:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000686e0f94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984677504:0@lo:103: 00000100:00100000:1.0:1789596643.093102:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.093316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677504 00000100:00100000:2.0:1789596643.093322:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677504 00010000:00010000:2.0:1789596643.093347:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 13 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.093371:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596643.093377:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041c97a79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+13:3647:x1876527984677504:12345-0@lo:103: 00010000:00010000:2.0:1789596643.093387:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596643.093390:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 13 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.093400:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 13 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.093414:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596643.093459:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041c97a79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+13:3647:x1876527984677504:12345-0@lo:103: Request processed in 82us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.093465:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596643.093641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000686e0f94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984677504:0@lo:103: 00000100:00100000:3.0:1789596643.100469:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052762120 going to sleep for 11 seconds 00010000:00010000:3.0:1789596643.100513:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071360e1b/0x7b5398e289bbe4ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe4e3 expref: 12 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.100531:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000033935ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984677120:0@lo:104: 00010000:00010000:3.0:1789596643.100544:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7cb7a05/0x7b5398e289bbe47a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe473 expref: 11 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.100552:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5741b59 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984677248:0@lo:104: 00000100:00100000:1.0:1789596643.100615:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677376 00000100:00100000:1.0:1789596643.100623:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677376 00000100:00100000:1.0:1789596643.100707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596643.100716:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c770eae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984677376:12345-0@lo:104: 00010000:00010000:1.0:1789596643.100730:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.100824:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596643.100829:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c770eae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984677376:12345-0@lo:104: Request processed in 115us (13678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.100837:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789596643.100851:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596643.100857:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.100865:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000665ab50b already unused, calling callback (0000000042805882) 10000000:00010000:2.0:1789596643.100868:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.100896:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596643.100903:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596643.100908:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596643.100949:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.100956:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789596643.100973:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984677376:0@lo:104: 00010000:00010000:2.0:1789596643.100975:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.100980:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000665ab50b/0x7b5398e289bbe457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe45e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.100995:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.100996:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596643.100998:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.100998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596643.101004:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596643.101015:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984677760:0@lo:103: 00000100:00100000:2.0:1789596643.101054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.101541:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677760 00000100:00100000:3.0:1789596643.101547:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677760 00010000:00010000:3.0:1789596643.101562:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 11 pid: 6513 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.101592:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596643.101598:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005871122b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+11:3644:x1876527984677760:12345-0@lo:103: 00010000:00010000:3.0:1789596643.101608:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596643.101612:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 11 pid: 6513 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101621:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 11 pid: 6513 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101634:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000895cb348/0x7b5398e289bbe45e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe457 expref: 11 pid: 6513 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101653:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101661:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101675:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101712:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101718:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101724:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101729:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005ef63173 already unused, calling callback (00000000308788ce) 00010000:00010000:3.0:1789596643.101732:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101739:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101753:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.101761:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596643.101783:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.101791:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.101796:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ef63173/0x7b5398e289bbe529 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.101801:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005871122b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+10:3644:x1876527984677760:12345-0@lo:103: Request processed in 205us (748us total) trans 0 rc 0/0 20000000:01000000:0.0:1789596643.101826:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789596643.102203:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984677760:0@lo:103: 00000100:00100000:3.0:1789596643.102632:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596643.103853:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2fb481d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+9:7449:x1876527984676992:12345-0@lo:253: Request processed in 58461us (58620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.103866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596643.103955:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984676992:0@lo:253: 10000000:01000000:2.0:1789596643.103971:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789596643.103974:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596643.103975:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789596643.103976:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596643.103977:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789596643.103988:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596643.103989:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596643.103990:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596643.103992:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789596643.103993:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596643.103994:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596643.104012:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d0bed55e from lustre-MDT0001 10000000:01000000:2.0:1789596643.104044:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789596643.104047:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789596643.104054:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7e88948000 local copy 10000000:01000000:2.0:1789596643.104057:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596643.104094:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.104104:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.104112:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.104128:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984677888:0@lo:101: 00000100:00100000:2.0:1789596643.104162:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.104201:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6303270 going to sleep for 11 seconds 00000100:00100000:1.0:1789596643.104250:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984677888 00000100:00100000:1.0:1789596643.104258:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984677888 00000100:00100000:1.0:1789596643.104310:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789596643.104317:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049f9bb15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+9:7449:x1876527984677888:12345-0@lo:101: 00010000:00010000:1.0:1789596643.104331:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596643.104342:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ae776bb/0x7b5398e289bbe537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.104363:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ae776bb/0x7b5398e289bbe537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe530 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.104372:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ae776bb/0x7b5398e289bbe537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe530 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.104379:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ae776bb, rc 0) 00000100:00100000:1.0:1789596643.104419:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049f9bb15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+10:7449:x1876527984677888:12345-0@lo:101: Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.104430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596643.104561:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984677888:0@lo:101: 00010000:00010000:2.0:1789596643.104574:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.104582:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.104768:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678016:0@lo:501: 00000100:00100000:2.0:1789596643.104795:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.104824:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f0bda44 going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.104976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678016 00000100:00100000:0.0:1789596643.104981:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678016 00000100:00100000:0.0:1789596643.105006:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596643.105012:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001750851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+10:7449:x1876527984678016:12345-0@lo:501: 00000100:00100000:0.0:1789596643.105077:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001750851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+10:7449:x1876527984678016:12345-0@lo:501: Request processed in 65us (282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596643.105084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596643.105106:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678016:0@lo:501: 10000000:01000000:0.0:1789596643.105118:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789596643.105135:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789596643.105139:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105146:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105152:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105169:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789596643.105190:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7eb9a66000 10000000:01000000:0.0:1789596643.105195:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789596643.105198:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c7e88948000 10000000:01000000:0.0:1789596643.105207:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789596643.105210:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c7e88948000 from 1 10000000:01000000:0.0:1789596643.105213:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789596643.105229:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105236:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105242:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596643.105254:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678144:0@lo:101: 00000100:00100000:0.0:1789596643.105290:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.105300:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e1f86ab going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.105318:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678144 00000100:00100000:0.0:1789596643.105321:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678144 00000100:00100000:0.0:1789596643.105336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596643.105342:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e0dca34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+10:7449:x1876527984678144:12345-0@lo:101: 00010000:00010000:0.0:1789596643.105348:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596643.105356:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071726813/0x7b5398e289bbe545 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe53e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105368:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071726813/0x7b5398e289bbe545 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe53e expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105375:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071726813/0x7b5398e289bbe545 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe53e expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105381:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071726813, rc 0) 00000100:00100000:0.0:1789596643.105412:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e0dca34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:7449:x1876527984678144:12345-0@lo:101: Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.105418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596643.105452:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678144:0@lo:101: 00010000:00010000:0.0:1789596643.105462:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105469:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596643.105481:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789596643.105489:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105495:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000083be03ba/0x7b5398e289bbe53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596643.105501:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7eb9a66000 10000000:01000000:0.0:1789596643.105504:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789596643.105507:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7eb9a66000 from 1 10000000:01000000:0.0:1789596643.105508:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789596643.105519:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105524:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105531:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596643.105551:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678272:0@lo:101: 00000100:00100000:0.0:1789596643.105572:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.105578:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e1f86ab going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.105611:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678272 00000100:00100000:0.0:1789596643.105615:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678272 00000100:00100000:0.0:1789596643.105629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596643.105634:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073f7bc9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+11:7449:x1876527984678272:12345-0@lo:101: 00010000:00010000:0.0:1789596643.105640:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596643.105645:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe54c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105657:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe54c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105664:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efc1aba5/0x7b5398e289bbe553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe54c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105671:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efc1aba5, rc 0) 00000100:00100000:0.0:1789596643.105725:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073f7bc9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:7449:x1876527984678272:12345-0@lo:101: Request processed in 90us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.105730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596643.105750:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678272:0@lo:101: 00010000:00010000:0.0:1789596643.105759:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105765:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596643.105784:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789596643.105791:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105797:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000009a4712ff/0x7b5398e289bbe54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596643.105801:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789596643.105804:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789596643.105808:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7eb9a66000 10000000:01000000:0.0:1789596643.105810:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789596643.105813:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789596643.105814:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789596643.105828:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105833:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105838:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596643.105847:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678400:0@lo:101: 00000100:00100000:0.0:1789596643.105870:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.105877:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e1f86ab going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.105896:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678400 00000100:00100000:0.0:1789596643.105900:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678400 00000100:00100000:0.0:1789596643.105917:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596643.105921:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb185e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:7449:x1876527984678400:12345-0@lo:101: 00010000:00010000:0.0:1789596643.105933:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596643.105940:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d75610bf/0x7b5398e289bbe561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe55a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105952:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d75610bf/0x7b5398e289bbe561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105959:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d75610bf/0x7b5398e289bbe561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.105964:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d75610bf, rc 0) 00000100:00100000:0.0:1789596643.105990:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb185e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678400:12345-0@lo:101: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.105996:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596643.106016:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678400:0@lo:101: 00010000:00010000:0.0:1789596643.106026:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.106032:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596643.106089:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678528:0@lo:501: 00000100:00100000:0.0:1789596643.106113:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.106135:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e1f86ab going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.106151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678528 00000100:00100000:0.0:1789596643.106154:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678528 00000100:00100000:0.0:1789596643.106168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789596643.106173:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003483d2cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678528:12345-0@lo:501: 00000100:00100000:0.0:1789596643.106266:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003483d2cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678528:12345-0@lo:501: Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.106272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789596643.106304:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678528:0@lo:501: 00000100:00100000:0.0:1789596643.106326:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678656:0@lo:503: 00000100:00100000:0.0:1789596643.106359:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.106366:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e1f86ab going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.106381:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678656 00000100:00100000:0.0:1789596643.106384:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678656 00000100:00100000:0.0:1789596643.106397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789596643.106402:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aef1a3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678656:12345-0@lo:503: 00000100:00100000:0.0:1789596643.106465:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aef1a3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678656:12345-0@lo:503: Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.106472:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789596643.106500:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678656:0@lo:503: 00000040:00080000:0.0:1789596643.106787:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789596643.106853:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678784:0@lo:502: 00000100:00100000:0.0:1789596643.106885:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.106894:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d28b3c9 going to sleep for 11 seconds 00000100:00100000:3.0:1789596643.106905:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678784 00000100:00100000:3.0:1789596643.106920:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678784 00000100:00100000:3.0:1789596643.106953:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596643.106959:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c4bc81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678784:12345-0@lo:502: 00000100:00100000:3.0:1789596643.107039:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c4bc81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984678784:12345-0@lo:502: Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.107045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789596643.110583:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596643.110607:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.110621:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009cc9a707 already unused, calling callback (0000000042805882) 10000000:00010000:1.0:1789596643.110625:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.110635:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596643.110641:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596643.110646:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596643.110705:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.110711:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596643.110741:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.110748:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe537 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596643.110773:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596643.110790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7ac32c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984678912:0@lo:103: 00000100:00100000:1.0:1789596643.110887:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596643.110952:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596643.110954:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596643.110956:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596643.111146:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984678784:0@lo:502: 00000040:00080000:0.0:1789596643.111399:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789596643.111431:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789596643.111519:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789596643.111534:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789596643.111545:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789596643.111557:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789596643.111583:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789596643.111597:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789596643.111610:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789596643.111621:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789596643.111632:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789596643.111643:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789596643.111654:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789596643.111666:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789596643.111793:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789596643.111815:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789596643.111828:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789596643.111840:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789596643.111870:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789596643.111886:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789596643.111898:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789596643.111910:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789596643.111923:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789596643.111950:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679040:0@lo:502: 00000100:00100000:0.0:1789596643.112001:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.112029:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d28b3c9 going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.112050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679040 00000100:00100000:0.0:1789596643.112056:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679040 00000100:00100000:0.0:1789596643.112134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596643.112143:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008157be37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984679040:12345-0@lo:502: 00000100:00100000:0.0:1789596643.112264:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008157be37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984679040:12345-0@lo:502: Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.112272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596643.112323:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679040:0@lo:502: 00000040:00080000:3.0:1789596643.112369:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789596643.112377:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:2.0:1789596643.112402:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984678912 00000100:00100000:2.0:1789596643.112407:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984678912 00000100:00100000:2.0:1789596643.112450:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596643.112456:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035d0d70b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+13:3647:x1876527984678912:12345-0@lo:103: 00010000:00010000:2.0:1789596643.112467:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596643.112483:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ae776bb/0x7b5398e289bbe537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe530 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.112497:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596643.112530:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035d0d70b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+12:3647:x1876527984678912:12345-0@lo:103: Request processed in 75us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.112537:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596643.112540:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7ac32c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984678912:0@lo:103: 00000020:01000000:1.0:1789596643.117086:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596643.117101:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596643.117104:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789596643.117110:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789596643.117112:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596643.117153:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002817681b) 00000020:00000080:1.0:1789596643.117179:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789596643.117187:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789596643.117275:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789596643.117298:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbe56f 00000020:00000080:1.0:1789596643.117544:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789596643.117549:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596643.117552:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596643.117553:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789596643.117556:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596643.117560:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596643.117561:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789596643.117564:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596643.117571:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000096e80bd0) 00000020:00000080:1.0:1789596643.117581:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789596643.117595:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789596643.117597:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789596643.117599:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789596643.117606:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789596643.117647:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0bed55e from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789596643.117659:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000042bc101) 00000020:00000080:1.0:1789596643.117710:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789596643.117782:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789596643.117787:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe584 00000020:00000080:1.0:1789596643.117880:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789596643.117891:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789596643.117896:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7b5398e289bbe58b 00080000:01000000:1.0:1789596643.117901:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789596643.117904:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbe592 00080000:10000000:1.0:1789596643.118336:0:7462:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789596643.118455:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789596643.247408:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789596643.248890:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789596643.253492:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789596643.253961:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000100:00100000:0.0:1789596643.260964:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f664125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984679296:0@lo:400: 00000100:00100000:0.0:1789596643.261037:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.261119:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679296 00000100:00100000:0.0:1789596643.261139:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679296 00000100:00100000:0.0:1789596643.261190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596643.261198:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036ecacd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984679296:12345-0@lo:400: 00000100:00100000:0.0:1789596643.261246:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036ecacd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984679296:12345-0@lo:400: Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.261253:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789596643.261305:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009f664125 x1876527984679296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596643.261320:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f664125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984679296:0@lo:400: 00000100:00100000:3.0:1789596643.261445:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000773a5b5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984679168:0@lo:400: 00000100:00100000:3.0:1789596643.261479:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.261671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679168 00000100:00100000:0.0:1789596643.261707:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679168 00000100:00100000:0.0:1789596643.261732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789596643.261738:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a377a594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+12:3647:x1876527984679168:12345-0@lo:400: 00000100:00100000:0.0:1789596643.261773:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a377a594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+12:3647:x1876527984679168:12345-0@lo:400: Request processed in 36us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.261779:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596643.261941:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000773a5b5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984679168:0@lo:400: 00000020:00000080:3.0:1789596643.278483:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789596643.278499:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596643.280380:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596643.280388:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789596643.280398:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596643.280405:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596643.280407:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789596643.280411:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789596643.280416:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:1.0:1789596643.280448:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596643.280463:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000a32ac612) 00000020:00000080:1.0:1789596643.280486:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789596643.280491:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789596643.280580:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789596643.280597:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789596643.280605:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbe5a0 00010000:00080000:1.0:1789596643.280640:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067cc4dc6@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789596643.285718:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1789596643.287207:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789596643.287222:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789596643.287261:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789596643.287293:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe5a7 00000100:00080000:0.0:1789596643.287305:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596643.287316:0:7462:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000067cc4dc6 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596643.287354:0:7462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009f664125 x1876527984679424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596643.287382:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789596643.287472:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596643.287477:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596643.287486:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789596643.287490:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789596643.287492:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789596643.287494:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789596643.287495:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789596643.287497:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789596643.287500:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596643.287501:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789596643.287504:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596643.287508:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596643.287509:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789596643.287513:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789596643.287543:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789596643.287556:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596643.287559:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596643.287560:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789596643.287562:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596643.287565:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596643.287567:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789596643.287569:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789596643.287571:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789596643.287596:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596643.287599:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596643.287600:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789596643.287602:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1789596643.287859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f664125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984679424:0@lo:38: 00000100:00100000:1.0:1789596643.287932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.288094:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679424 00000100:00100000:0.0:1789596643.288102:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679424 00000100:00100000:0.0:1789596643.288145:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596643.288151:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000babb5c91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984679424:12345-0@lo:38: 00010000:00080000:0.0:1789596643.288174:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1789596643.288201:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe5ae 00000004:00100000:0.0:1789596643.288214:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789596643.288220:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1789596643.288515:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1789596643.288556:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789596643.288576:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.288588:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000003d5d54dd/0x7b5398e289bbe55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596643.288597:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb9a66000 from 1 10000000:01000000:2.0:1789596643.288600:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596643.288629:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.288636:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.288656:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.288673:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000838196b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679552:0@lo:101: 00000100:00100000:2.0:1789596643.288744:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.288760:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3608398 going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.289491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679552 00000100:00100000:0.0:1789596643.289499:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679552 00000100:00100000:0.0:1789596643.289548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789596643.289557:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a03d9326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+12:7449:x1876527984679552:12345-0@lo:101: 00010000:00010000:0.0:1789596643.289569:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596643.289581:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe5b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.289603:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.289613:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.289623:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000394baa16, rc 0) 00000100:00100000:0.0:1789596643.289671:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a03d9326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984679552:12345-0@lo:101: Request processed in 116us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.289726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789596643.289952:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000838196b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679552:0@lo:101: 00010000:00010000:2.0:1789596643.289969:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.289978:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.292091:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000838196b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679680:0@lo:256: 00000100:00100000:2.0:1789596643.293021:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.293062:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3608398 going to sleep for 11 seconds 00000100:00100000:1.0:1789596643.293128:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679680 00000100:00100000:1.0:1789596643.293293:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679680 00000100:00100000:1.0:1789596643.293371:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596643.293379:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a588e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984679680:12345-0@lo:256: 20000000:01000000:1.0:1789596643.293400:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789596643.293420:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789596643.293423:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789596643.294240:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a588e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984679680:12345-0@lo:256: Request processed in 860us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.294249:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789596643.294604:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000c5695a37 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596643.294655:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000babb5c91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984679424:12345-0@lo:38: Request processed in 6504us (6724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.294669:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596643.294741:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596643.294752:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789596643.294762:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789596643.294768:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789596643.294771:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000067cc4dc6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789596643.294783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f664125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984679424:0@lo:38: 00000100:00100000:3.0:1789596643.295222:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000838196b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679680:0@lo:256: 10000000:01000000:3.0:1789596643.295841:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789596643.295864:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.295875:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596643.295892:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb9a66000 from 1 10000000:01000000:3.0:1789596643.295895:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596643.295927:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.295934:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.295941:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.295958:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679808:0@lo:101: 00000100:00100000:3.0:1789596643.296001:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.296580:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7768fd5 going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.296662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679808 00000100:00100000:0.0:1789596643.296669:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679808 00000100:00100000:0.0:1789596643.296735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789596643.296742:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad89d381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:7449:x1876527984679808:12345-0@lo:101: 00010000:00010000:0.0:1789596643.296756:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596643.296768:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe5c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.296792:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.297042:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.297063:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c026bda3, rc 0) 00000100:00100000:0.0:1789596643.297114:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad89d381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:7449:x1876527984679808:12345-0@lo:101: Request processed in 372us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.297120:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789596643.297230:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984679808:0@lo:101: 00010000:00010000:3.0:1789596643.297243:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.297252:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.297362:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680064:0@lo:501: 00000100:00100000:3.0:1789596643.297392:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.297420:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7768fd5 going to sleep for 11 seconds 00000100:00100000:1.0:1789596643.297466:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680064 00000100:00100000:1.0:1789596643.297471:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680064 00000100:00100000:1.0:1789596643.297493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789596643.297499:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076710643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:7449:x1876527984680064:12345-0@lo:501: 00000100:00100000:1.0:1789596643.297608:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076710643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:7449:x1876527984680064:12345-0@lo:501: Request processed in 110us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.297615:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789596643.297709:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680064:0@lo:501: 00000100:00100000:3.0:1789596643.297738:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680192:0@lo:503: 00000100:00100000:3.0:1789596643.297786:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.297801:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7768fd5 going to sleep for 11 seconds 00000100:00100000:1.0:1789596643.297972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680192 00000100:00100000:1.0:1789596643.297976:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680192 00000100:00100000:1.0:1789596643.297994:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789596643.297999:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005313eb1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:7449:x1876527984680192:12345-0@lo:503: 00000040:00080000:1.0:1789596643.298029:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596643.298066:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005313eb1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:7449:x1876527984680192:12345-0@lo:503: Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.298073:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789596643.298218:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680192:0@lo:503: 00000040:00080000:3.0:1789596643.298520:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596643.298567:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789596643.298640:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789596643.298777:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984679936:0@lo:41: 00000100:00100000:0.0:1789596643.298994:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.299098:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984679936 00000100:00100000:3.0:1789596643.299104:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984679936 00000100:00100000:3.0:1789596643.299409:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596643.299418:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a97bdbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984679936:12345-0@lo:41: 00000004:00000024:3.0:1789596643.299449:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789596643.299538:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a97bdbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984679936:12345-0@lo:41: Request processed in 121us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.299544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1789596643.300393:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789596643.300666:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789596643.300733:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596643.300743:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.300755:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596643.300807:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789596643.300810:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7eb9a66000 10000000:01000000:3.0:1789596643.300813:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7eb9a66000 10000000:01000000:3.0:1789596643.300816:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596643.300831:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7eb9a66000 from 1 10000000:01000000:3.0:1789596643.300834:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789596643.300865:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.300883:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.300893:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.300913:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680320:0@lo:101: 00000100:00100000:3.0:1789596643.300965:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.301003:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064f17cbb going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.301269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680320 00000100:00100000:0.0:1789596643.301275:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680320 00000100:00100000:0.0:1789596643.301319:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789596643.301326:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073e1fe6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:7449:x1876527984680320:12345-0@lo:101: 00010000:00010000:0.0:1789596643.301336:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596643.301348:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1bb85a2/0x7b5398e289bbe5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe5d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.301369:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1bb85a2/0x7b5398e289bbe5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.301379:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1bb85a2/0x7b5398e289bbe5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596643.301387:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1bb85a2, rc 0) 00000100:00100000:0.0:1789596643.301427:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073e1fe6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680320:12345-0@lo:101: Request processed in 102us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.301433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789596643.301502:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680320:0@lo:101: 00010000:00010000:3.0:1789596643.301515:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596643.301523:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596643.301608:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680448:0@lo:501: 00000100:00100000:3.0:1789596643.301634:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.301663:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064f17cbb going to sleep for 11 seconds 00000100:00100000:2.0:1789596643.301771:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680448 00000100:00100000:2.0:1789596643.301777:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680448 00000100:00100000:2.0:1789596643.301819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596643.301834:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000788516cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680448:12345-0@lo:501: 00000100:00100000:2.0:1789596643.301937:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000788516cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680448:12345-0@lo:501: Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.301943:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596643.301973:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02a0b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680448:0@lo:501: 00000100:00100000:2.0:1789596643.301999:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc8fd84b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680576:0@lo:503: 00000100:00100000:2.0:1789596643.302043:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.302060:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d49bb490 going to sleep for 11 seconds 00000100:00100000:2.0:1789596643.302071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680576 00000100:00100000:2.0:1789596643.302074:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680576 00000100:00100000:2.0:1789596643.302088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789596643.302092:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084263b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680576:12345-0@lo:503: 00000100:00100000:2.0:1789596643.302268:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084263b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680576:12345-0@lo:503: Request processed in 175us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.302275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789596643.302326:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc8fd84b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680576:0@lo:503: 00000040:00080000:2.0:1789596643.302589:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596643.302655:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc8fd84b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680704:0@lo:502: 00000100:00100000:2.0:1789596643.302713:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.302727:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d49bb490 going to sleep for 11 seconds 00000100:00100000:2.0:1789596643.302741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680704 00000100:00100000:2.0:1789596643.302744:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680704 00000100:00100000:2.0:1789596643.302763:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789596643.302774:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a19428ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680704:12345-0@lo:502: 00000100:00100000:2.0:1789596643.303080:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a19428ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680704:12345-0@lo:502: Request processed in 305us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.303088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789596643.303370:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984679936:0@lo:41: 00000100:00100000:3.0:1789596643.303423:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc8fd84b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680704:0@lo:502: 00000040:00080000:3.0:1789596643.303609:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789596643.303636:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789596643.303650:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789596643.303664:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789596643.303930:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789596643.303954:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789596643.303967:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789596643.303987:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789596643.304014:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789596643.304028:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789596643.304041:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789596643.304053:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789596643.304065:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789596643.304078:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789596643.304090:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789596643.304103:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789596643.304117:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789596643.304128:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789596643.304219:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789596643.304234:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789596643.304248:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789596643.304259:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789596643.304271:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789596643.304322:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789596643.304352:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789596643.304368:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789596643.304381:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789596643.304393:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1789596643.304426:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5741b59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680832:0@lo:502: 00000100:00100000:3.0:1789596643.304485:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.304568:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e160ccf going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.304612:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680832 00000100:00100000:0.0:1789596643.304619:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680832 00000100:00100000:0.0:1789596643.304742:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789596643.304751:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000003c059a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680832:12345-0@lo:502: 00000100:00100000:0.0:1789596643.305061:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000003c059a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984680832:12345-0@lo:502: Request processed in 313us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.305069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596643.305143:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5741b59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984680832:0@lo:502: 00000040:00080000:3.0:1789596643.305190:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789596643.305199:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789596643.305771:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789596643.305786:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000168f82a9) 00000020:00000080:3.0:1789596643.305817:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789596643.305911:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0bed55e from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789596643.305919:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d0bed55e from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789596643.305921:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d0bed55e 3 00010000:00080000:3.0:1789596643.305960:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004d461914@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596643.307604:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789596643.307859:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789596643.307902:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596643.307916:0:7468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7b5398e289bbe5e6 00000100:00080000:3.0:1789596643.307927:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596643.307938:0:7468:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000004d461914 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596643.307975:0:7468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e5741b59 x1876527984680960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596643.308006:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789596643.312346:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5741b59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984680960:0@lo:38: 00000100:00100000:2.0:1789596643.312437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.312516:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984680960 00000100:00100000:2.0:1789596643.312525:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984680960 00000100:00100000:2.0:1789596643.312561:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596643.312568:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bc702f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984680960:12345-0@lo:38: 00010000:00080000:2.0:1789596643.312611:0:6519:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1789596643.312694:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7b5398e289bbe5ed 00000004:00100000:2.0:1789596643.312712:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789596643.312742:0:6519:0:(import.c:65:import_set_state_nolock()) 00000000d326f9f0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596643.312794:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bc702f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876527984680960:12345-0@lo:38: Request processed in 226us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.312814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789596643.312978:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e5741b59 x1876527984680960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596643.312990:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596643.312998:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789596643.313005:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789596643.313010:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789596643.313012:0:3643:0:(import.c:65:import_set_state_nolock()) 000000004d461914 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789596643.313017:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5741b59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984680960:0@lo:38: 00000040:00080000:3.0:1789596643.313349:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1789596643.313504:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1789596643.319478:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789596643.319536:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596643.319558:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596643.319573:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000008f255aeb/0x7b5398e289bbe5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789596643.319646:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789596643.319652:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789596643.319653:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596643.319654:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596643.319655:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596643.319656:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596643.319657:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789596643.319658:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596643.319659:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596643.319660:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596643.319661:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789596643.319665:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789596643.319667:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789596643.319668:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789596643.319669:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596643.319670:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596643.319671:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596643.319672:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596643.319673:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789596643.319674:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596643.319674:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596643.319694:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596643.319696:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789596643.319728:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789596643.319745:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984681088:0@lo:253: 00000100:00100000:1.0:1789596643.319922:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.319968:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec708a03 going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.320065:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681088 00000100:00100000:0.0:1789596643.320073:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681088 00000100:00100000:0.0:1789596643.320128:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596643.320305:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffd28b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984681088:12345-0@lo:253: 20000000:01000000:0.0:1789596643.320337:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789596643.320350:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789596643.323978:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789596643.324056:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789596643.324076:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789596643.324453:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffd28b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:7449:x1876527984681088:12345-0@lo:253: Request processed in 4147us (4526us total) trans 0 rc 0/0 20000000:01000000:2.0:1789596643.325910:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789596643.325918:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789596643.325939:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.325956:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.325964:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.325970:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326010:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326025:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 15 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.326039:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066185e71 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984681216:0@lo:104: 00000100:00100000:2.0:1789596643.326105:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596643.326154:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326162:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 15 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.326170:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a463672c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984681344:0@lo:104: 00000100:00100000:2.0:1789596643.326188:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.326212:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f2df941 going to sleep for 11 seconds 00000100:00100000:2.0:1789596643.326238:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681216 00000100:00100000:2.0:1789596643.326244:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681216 00000100:00100000:2.0:1789596643.326275:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681344 00000100:00100000:2.0:1789596643.326289:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681344 00000100:00100000:2.0:1789596643.326305:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596643.326311:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c332d30f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6535:x1876527984681216:12345-0@lo:104: 00010000:00010000:2.0:1789596643.326323:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326369:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596643.326374:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c332d30f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6535:x1876527984681216:12345-0@lo:104: Request processed in 64us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.326381:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596643.326397:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596643.326402:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000256c775b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984681344:12345-0@lo:104: 00010000:00010000:2.0:1789596643.326409:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326436:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596643.326440:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000256c775b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984681344:12345-0@lo:104: Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.326445:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789596643.326463:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596643.326468:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326476:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009cc9a707 already unused, calling callback (0000000042805882) 10000000:00010000:2.0:1789596643.326479:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326492:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596643.326499:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596643.326504:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596643.326532:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326539:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596643.326558:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326563:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000009cc9a707/0x7b5398e289bbe5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5bc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326576:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596643.326578:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326583:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bda88bb9 already unused, calling callback (0000000042805882) 10000000:00010000:2.0:1789596643.326584:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326589:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596643.326594:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596643.326604:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596643.326617:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326623:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596643.326627:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326632:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000bda88bb9/0x7b5398e289bbe50d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe514 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.326647:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.326648:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596643.326654:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596643.326666:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f0e8fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984681472:0@lo:103: 00000100:00100000:2.0:1789596643.326715:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.326736:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596643.326741:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048600549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984681600:0@lo:103: 00000100:00100000:2.0:1789596643.326764:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596643.326792:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681472 00000100:00100000:2.0:1789596643.326795:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681472 00010000:00010000:2.0:1789596643.326824:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 16 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.326844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681600 00000100:00100000:2.0:1789596643.326847:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681600 00010000:00010000:2.0:1789596643.326856:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 17 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.326880:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596643.326885:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018ea32aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+17:3646:x1876527984681472:12345-0@lo:103: 00010000:00010000:2.0:1789596643.326895:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596643.326898:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 17 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326907:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 17 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326919:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596643.326948:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018ea32aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+17:3646:x1876527984681472:12345-0@lo:103: Request processed in 63us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.326953:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596643.326965:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596643.326970:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009479bab7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+16:3646:x1876527984681600:12345-0@lo:103: 00010000:00010000:2.0:1789596643.326976:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596643.326979:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 16 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326986:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 16 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.326994:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327000:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596643.327020:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008550985s 00010000:00010000:2.0:1789596643.327024:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327029:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327034:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327039:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327043:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008e1f3bc2 already unused, calling callback (00000000308788ce) 00010000:00010000:2.0:1789596643.327046:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327052:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327059:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327066:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596643.327088:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009479bab7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+16:3646:x1876527984681600:12345-0@lo:103: Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596643.327094:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789596643.327155:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000394baa16/0x7b5398e289bbe5bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe5b5 expref: 15 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.327177:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066185e71 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984681216:0@lo:104: 00010000:00010000:2.0:1789596643.327188:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b9a59bf/0x7b5398e289bbe514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe50d expref: 14 pid: 6514 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.327196:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a463672c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984681344:0@lo:104: 00010000:00010000:2.0:1789596643.327210:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327217:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327223:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596643.327228:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008e1f3bc2/0x7b5398e289bbe5f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596643.327255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048600549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984681600:0@lo:103: 00000100:00100000:2.0:1789596643.327262:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f0e8fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984681472:0@lo:103: 00000100:00100000:1.0:1789596643.328343:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:7449:1876527984681088:0@lo:253: 10000000:01000000:1.0:1789596643.328358:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789596643.328361:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789596643.328363:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789596643.328364:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596643.328365:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596643.328367:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596643.328368:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596643.328369:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789596643.328370:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596643.328372:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596643.328373:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596643.328383:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789596643.328398:0:7449:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789596643.329882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00080000:10000000:1.0:1789596643.334611:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789596643.334817:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789596643.335031:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789596643.335225:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789596643.335483:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789596643.335649:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789596643.338269:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789596643.338493:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789596643.338909:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789596643.339095:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789596643.339360:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1789596643.339525:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789596643.342391:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789596643.342733:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789596643.342793:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000033935ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876527984681728:0@lo:700: 00000040:01000000:2.0:1789596643.342889:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789596643.343037:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596643.343102:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dd35d2e going to sleep for 11 seconds 00000100:00100000:2.0:1789596643.343225:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681728 00000100:00100000:2.0:1789596643.343234:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681728 00000100:00100000:2.0:1789596643.343294:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596643.343303:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058fd7475 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1876527984681728:12345-0@lo:700: 00000100:00100000:1.0:1789596643.343730:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984681856:0@lo:1000: 00000100:00100000:1.0:1789596643.343769:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.343794:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f10ee1b7 going to sleep for 11 seconds 00000100:00100000:3.0:1789596643.343940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681856 00000100:00100000:3.0:1789596643.343945:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681856 00000100:00100000:3.0:1789596643.343974:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596643.343980:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076be267f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984681856:12345-0@lo:1000: 00000100:00100000:3.0:1789596643.344056:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076be267f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984681856:12345-0@lo:1000: Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.344063:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:2.0:1789596643.344574:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789596643.344727:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596643.344934:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984681856:0@lo:1000: 00000040:01000000:1.0:1789596643.344970:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789596643.344999:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984681984:0@lo:700: 00000100:00100000:1.0:1789596643.345040:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.345069:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f10ee1b7 going to sleep for 11 seconds 00000100:00100000:3.0:1789596643.345217:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984681984 00000100:00100000:3.0:1789596643.345222:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984681984 00000100:00100000:3.0:1789596643.345255:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596643.345260:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f09deccd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984681984:12345-0@lo:700: 00000100:00100000:3.0:1789596643.345321:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f09deccd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984681984:12345-0@lo:700: Request processed in 61us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.345327:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596643.345389:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984681984:0@lo:700: 00000100:00100000:1.0:1789596643.345429:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876527984682112:0@lo:900: 00000100:00100000:1.0:1789596643.345454:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.345478:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f10ee1b7 going to sleep for 11 seconds 00000020:00080000:0.0:1789596643.345556:0:7473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789596643.345561:0:7473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789596643.345610:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984682112 00000100:00100000:3.0:1789596643.345615:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984682112 00000100:00100000:3.0:1789596643.345772:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596643.345779:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004dd6a884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1876527984682112:12345-0@lo:900: 00000100:00100000:3.0:1789596643.346273:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004dd6a884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1876527984682112:12345-0@lo:900: Request processed in 494us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.346293:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789596643.346368:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007bc9be43 x1876527984682112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789596659 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596643.346382:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876527984682112:0@lo:900: 00000100:00100000:1.0:1789596643.346487:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984682240:0@lo:1000: 00000100:00100000:1.0:1789596643.346528:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.346553:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000001519501d going to sleep for 11 seconds 00000100:00100000:3.0:1789596643.346607:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984682240 00000100:00100000:3.0:1789596643.346613:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984682240 00000100:00100000:3.0:1789596643.346645:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596643.346652:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b26887 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984682240:12345-0@lo:1000: 00000004:00000080:2.0:1789596643.347037:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789596643.347058:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1789596643.347247:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b26887 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984682240:12345-0@lo:1000: Request processed in 595us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.347255:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596643.347327:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984682240:0@lo:1000: 00000004:00080000:1.0:1789596643.347375:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f10ee1b7 with version 0 00000020:00100000:1.0:1789596643.347389:0:7475:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789596643.347394:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007bc9be43 x1876527984682496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596643.347407:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984682496:0@lo:1000: 00000100:00100000:1.0:1789596643.347430:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.347453:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054bbd26a going to sleep for 11 seconds 00000100:00100000:0.0:1789596643.347904:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984682496 00000100:00100000:0.0:1789596643.347910:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984682496 00000100:00100000:0.0:1789596643.347953:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596643.347959:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3997a41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984682496:12345-0@lo:1000: 00000040:00080000:2.0:1789596643.348535:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:0.0:1789596643.350234:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:2.0:1789596643.351580:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789596643.353952:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789596643.354046:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789596643.354401:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789596643.356074:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789596643.358897:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789596643.359129:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789596643.359406:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789596643.359529:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789596643.360349:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789596643.360571:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789596643.360775:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789596643.362162:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789596643.362358:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789596643.362491:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789596643.362624:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789596643.362799:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000001:00080000:0.0:1789596643.363919:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789596643.364114:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3997a41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984682496:12345-0@lo:1000: Request processed in 16151us (16679us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789596643.364140:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:2.0:1789596643.364524:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000004:00080000:0.0:1789596643.364787:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789596643.364792:0:7475:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789596643.364817:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc9be43 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984682496:0@lo:1000: 00000100:00100000:0.0:1789596643.364912:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae4f7e87 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984682624:0@lo:1000: 00000100:00100000:0.0:1789596643.364962:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.365015:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051de8bac going to sleep for 11 seconds 00000100:00100000:1.0:1789596643.365147:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984682624 00000100:00100000:1.0:1789596643.365154:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984682624 00000100:00100000:1.0:1789596643.365198:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596643.365206:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000721fe116 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984682624:12345-0@lo:1000: 00000100:00100000:1.0:1789596643.365275:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000721fe116 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876527984682624:12345-0@lo:1000: Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.365294:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596643.365321:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae4f7e87 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876527984682624:0@lo:1000: 00000040:00080000:1.0:1789596643.365338:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789596643.365369:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001519501d with version 1 00000004:00080000:1.0:1789596643.365385:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005aacb2cf version 1 rpc_version 1 00000020:00100000:1.0:1789596643.365399:0:7465:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789596643.365405:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b9e5fad0 x1876527984682880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596643.365418:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9e5fad0 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1876527984682880:0@lo:1000: 00000100:00100000:1.0:1789596643.365452:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.365464:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c438397d going to sleep for 11 seconds 00000100:00100000:1.0:1789596643.365475:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984682880 00000100:00100000:1.0:1789596643.365478:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984682880 00000100:00100000:1.0:1789596643.365507:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596643.365512:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3bf54c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1876527984682880:12345-0@lo:1000: 00100000:10000000:2.0:1789596643.367227:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789596643.367613:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789596643.367782:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:3.0:1789596643.368320:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058fd7475 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1876527984681728:12345-0@lo:700: Request processed in 25013us (25279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.368350:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789596643.368471:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000033935ad x1876527984681728/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789596659 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596643.368486:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000033935ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876527984681728:0@lo:700: 40000000:02000000:0.0:1789596643.368499:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1789596643.374851:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789596643.374993:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789596643.375133:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000040:00080000:1.0:1789596643.378894:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789596643.378989:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1789596643.380959:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789596643.381099:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3bf54c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1876527984682880:12345-0@lo:1000: Request processed in 15584us (15643us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789596643.381111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00100000:10000000:2.0:1789596643.381339:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789596643.381642:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789596643.381833:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789596643.381963:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789596643.382104:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789596643.382368:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789596643.382534:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789596643.382720:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000004:00080000:1.0:1789596643.382997:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789596643.383003:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789596643.383026:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9e5fad0 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1876527984682880:0@lo:1000: 00100000:10000000:2.0:1789596643.383339:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789596643.389699:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789596643.393206:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789596643.393382:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789596643.393540:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789596643.393799:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789596643.410553:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789596643.411363:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789596643.411401:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc0dc41dfb988 00100000:10000000:1.0:1789596643.411410:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789596643.412666:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789596643.412746:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789596643.412771:0:7449:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789596643.412814:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789596643.416821:0:7449:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789596643.417081:0:7449:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1789596643.449622:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789596643.449757:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789596643.449763:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789596643.779609:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596644.797581:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596645.824298:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596646.844881:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596647.869908:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596647.927962:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789596648.381058:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984683392:0@lo:400: 00000100:00100000:0.0:1789596648.381121:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596648.381174:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596648.381178:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984683264:0@lo:400: 00000100:00100000:0.0:1789596648.381195:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596648.381221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683392 00000100:00100000:0.0:1789596648.381229:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683392 00000100:00100000:0.0:1789596648.381287:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596648.381292:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f664125 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984683392:12345-0@lo:400: 00000100:00100000:0.0:1789596648.381349:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f664125 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984683392:12345-0@lo:400: Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596648.381355:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596648.381380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683264 00000100:00100000:0.0:1789596648.381383:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683264 00000100:00100000:0.0:1789596648.381412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596648.381416:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000773a5b5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984683264:12345-0@lo:400: 00000100:00100000:0.0:1789596648.381445:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000773a5b5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984683264:12345-0@lo:400: Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596648.381465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789596648.381496:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000055d49d3 x1876527984683264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596648.381505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984683264:0@lo:400: 00000100:00100000:0.0:1789596648.381511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984683392:0@lo:400: 00000100:00100000:3.0:1789596648.381645:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984683136:0@lo:400: 00000100:00100000:3.0:1789596648.381673:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596648.381717:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789596648.381721:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9e5fad0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984683008:0@lo:41: 00000100:00100000:3.0:1789596648.381740:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596648.381748:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae4f7e87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984683520:0@lo:400: 00000100:00100000:3.0:1789596648.381758:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596648.381781:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683520 00000100:00100000:3.0:1789596648.381784:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683520 00000100:00100000:3.0:1789596648.381807:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596648.381813:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008eca8fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984683520:12345-0@lo:400: 00000100:00100000:3.0:1789596648.381845:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008eca8fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984683520:12345-0@lo:400: Request processed in 33us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596648.381852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789596648.381876:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ae4f7e87 x1876527984683520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596648.381885:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae4f7e87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984683520:0@lo:400: 00000100:00100000:0.0:1789596648.382451:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683136 00000100:00100000:0.0:1789596648.382456:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683136 00000100:00100000:0.0:1789596648.382573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789596648.382580:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e41b613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+13:3645:x1876527984683136:12345-0@lo:400: 00000100:00100000:0.0:1789596648.382632:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e41b613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+13:3645:x1876527984683136:12345-0@lo:400: Request processed in 54us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596648.382636:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596648.382710:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984683136:0@lo:400: 00000100:00100000:3.0:1789596648.384036:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683008 00000100:00100000:3.0:1789596648.384048:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683008 00000100:00100000:3.0:1789596648.384088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596648.384093:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048967532 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984683008:12345-0@lo:41: 00000004:00000024:3.0:1789596648.384135:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789596648.384189:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048967532 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984683008:12345-0@lo:41: Request processed in 96us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596648.384193:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596648.384247:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9e5fad0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984683008:0@lo:41: 00010000:00010000:0.0:1789596648.898345:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789596648.941924:0:7772:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789596648.942128:0:7772:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789596649.916886:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596650.945378:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596651.453491:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596651.453498:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb9a66000 from 4 10000000:01000000:2.0:1789596651.453503:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596651.453545:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.453575:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.453585:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.453607:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f0e8fcc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984683648:0@lo:101: 00000100:00100000:2.0:1789596651.453850:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.453952:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f0bda44 going to sleep for 11 seconds 00000100:00100000:0.0:1789596651.455480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683648 00000100:00100000:0.0:1789596651.455491:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683648 00000100:00100000:0.0:1789596651.455601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596651.455612:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050e62419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:6517:x1876527984683648:12345-0@lo:101: 00010000:00010000:0.0:1789596651.455628:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596651.455647:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb23353f/0x7b5398e289bbe602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe5fb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.455674:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb23353f/0x7b5398e289bbe602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.455709:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb23353f/0x7b5398e289bbe602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.455742:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb23353f, rc 0) 00000100:00100000:0.0:1789596651.455817:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050e62419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:6517:x1876527984683648:12345-0@lo:101: Request processed in 207us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.455823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789596651.455908:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f0e8fcc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984683648:0@lo:101: 00010000:00010000:1.0:1789596651.455926:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.455934:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596651.456005:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984683776:0@lo:256: 00000100:00100000:1.0:1789596651.456046:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596651.463003:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d5e6f4b going to sleep for 11 seconds 00000100:00100000:2.0:1789596651.463093:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683776 00000100:00100000:2.0:1789596651.463107:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683776 00000100:00100000:0.0:1789596651.463198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596651.463222:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001210b52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:6517:x1876527984683776:12345-0@lo:256: 20000000:01000000:0.0:1789596651.463253:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596651.463282:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596651.463285:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789596651.463421:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001210b52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:6517:x1876527984683776:12345-0@lo:256: Request processed in 203us (7375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.463430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789596651.463514:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984683776:0@lo:256: 10000000:01000000:1.0:1789596651.463569:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789596651.463579:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.463590:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000002245e33/0x7b5398e289bbe5fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596651.463601:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789596651.463603:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e867d5800 from 21 10000000:01000000:1.0:1789596651.463606:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596651.463639:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.463646:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.463654:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596651.463672:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984683904:0@lo:101: 00000100:00100000:1.0:1789596651.463724:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596651.465471:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d5e6f4b going to sleep for 11 seconds 00000100:00100000:3.0:1789596651.465543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984683904 00000100:00100000:3.0:1789596651.465551:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984683904 00000100:00100000:3.0:1789596651.465594:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789596651.465601:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e02f0738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:6517:x1876527984683904:12345-0@lo:101: 00010000:00010000:3.0:1789596651.465614:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596651.465628:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000926566be/0x7b5398e289bbe610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe609 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.465652:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000926566be/0x7b5398e289bbe610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.465661:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000926566be/0x7b5398e289bbe610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.465669:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000926566be, rc 0) 00000100:00100000:3.0:1789596651.465754:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e02f0738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984683904:12345-0@lo:101: Request processed in 153us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596651.465761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789596651.465890:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984683904:0@lo:101: 00010000:00010000:1.0:1789596651.465921:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.465930:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596651.466002:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684032:0@lo:501: 00000100:00100000:1.0:1789596651.466030:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596651.466059:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d5e6f4b going to sleep for 11 seconds 00000100:00100000:3.0:1789596651.467367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684032 00000100:00100000:3.0:1789596651.467380:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684032 00000100:00100000:3.0:1789596651.467424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789596651.467432:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001edb5105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984684032:12345-0@lo:501: 00000100:00100000:3.0:1789596651.467593:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001edb5105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984684032:12345-0@lo:501: Request processed in 161us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596651.467613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789596651.467742:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684032:0@lo:501: 00000100:00100000:1.0:1789596651.467788:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684160:0@lo:503: 00000100:00100000:1.0:1789596651.467834:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596651.467861:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d5e6f4b going to sleep for 11 seconds 00000100:00100000:3.0:1789596651.467994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684160 00000100:00100000:3.0:1789596651.467999:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684160 00000100:00100000:3.0:1789596651.468018:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596651.468023:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f0e7652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984684160:12345-0@lo:503: 00000100:00100000:3.0:1789596651.468097:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f0e7652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984684160:12345-0@lo:503: Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596651.468103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789596651.468281:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684160:0@lo:503: 00000100:00100000:2.0:1789596651.468668:0:7843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048600549 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7843:1876527984684288:0@lo:502: 00000100:00100000:2.0:1789596651.468859:0:7843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.468894:0:7843:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010faed94 going to sleep for 11 seconds 00000100:00100000:3.0:1789596651.468943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684288 00000100:00100000:3.0:1789596651.468949:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684288 00000100:00100000:3.0:1789596651.468983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789596651.468990:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ed4b7f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:7843:x1876527984684288:12345-0@lo:502: 00000100:00100000:3.0:1789596651.469087:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ed4b7f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:7843:x1876527984684288:12345-0@lo:502: Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596651.469095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789596651.469291:0:7843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048600549 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7843:1876527984684288:0@lo:502: 00000100:00100000:1.0:1789596651.469333:0:7843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7843:1876527984684416:0@lo:502: 00000100:00100000:1.0:1789596651.469362:0:7843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596651.469414:0:7843:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d5e6f4b going to sleep for 11 seconds 00000100:00100000:3.0:1789596651.472476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684416 00000100:00100000:3.0:1789596651.472495:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684416 00000100:00100000:0.0:1789596651.472842:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789596651.472853:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e157e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:7843:x1876527984684416:12345-0@lo:502: 00000100:00100000:0.0:1789596651.473114:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e157e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:7843:x1876527984684416:12345-0@lo:502: Request processed in 263us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.473124:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789596651.476434:0:7843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7843:1876527984684416:0@lo:502: 00000040:00080000:1.0:1789596651.476489:0:7843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789596651.477308:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789596651.477340:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789596651.477353:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.477364:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000c0dbe49a/0x7b5398e289bbe609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596651.477377:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596651.477379:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7e867d5800 from 4 10000000:01000000:2.0:1789596651.477382:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596651.477496:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.477505:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.477533:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.477556:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a463672c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684544:0@lo:101: 00000100:00100000:2.0:1789596651.477633:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.477763:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b3bfc69 going to sleep for 11 seconds 00000100:00100000:0.0:1789596651.478536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684544 00000100:00100000:0.0:1789596651.478546:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684544 00000100:00100000:0.0:1789596651.478602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789596651.478608:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026370b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984684544:12345-0@lo:101: 00010000:00010000:0.0:1789596651.478622:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596651.478634:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000394baa16/0x7b5398e289bbe61e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe617 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.478657:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000394baa16/0x7b5398e289bbe61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.478675:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000394baa16/0x7b5398e289bbe61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.478697:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000394baa16, rc 0) 00000100:00100000:0.0:1789596651.478747:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026370b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984684544:12345-0@lo:101: Request processed in 140us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.478753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789596651.478801:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a463672c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684544:0@lo:101: 00010000:00010000:0.0:1789596651.478814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.478821:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596651.478868:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684672:0@lo:256: 00000100:00100000:0.0:1789596651.478899:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596651.478943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684672 00000100:00100000:0.0:1789596651.478945:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001519501d going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.478950:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684672 00000100:00100000:1.0:1789596651.478999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789596651.479006:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed1cb09e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984684672:12345-0@lo:256: 20000000:01000000:1.0:1789596651.479020:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789596651.479044:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789596651.479047:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789596651.479150:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed1cb09e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984684672:12345-0@lo:256: Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.479158:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789596651.479167:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684672:0@lo:256: 10000000:01000000:0.0:1789596651.479223:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789596651.479229:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.479237:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000ae0ab5cf/0x7b5398e289bbe617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596651.479245:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789596651.479252:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789596651.479255:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596651.479271:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.479277:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.479284:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596651.479294:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684800:0@lo:101: 00000100:00100000:0.0:1789596651.479317:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.479340:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b66e5a43 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.479374:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684800 00000100:00100000:1.0:1789596651.479380:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684800 00000100:00100000:1.0:1789596651.479409:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789596651.479416:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd00764a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984684800:12345-0@lo:101: 00010000:00010000:1.0:1789596651.479425:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596651.479435:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb49b774/0x7b5398e289bbe62c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe625 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.479450:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb49b774/0x7b5398e289bbe62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.479459:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb49b774/0x7b5398e289bbe62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596651.479465:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb49b774, rc 0) 00000100:00100000:1.0:1789596651.479498:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd00764a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984684800:12345-0@lo:101: Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.479505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789596651.479529:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684800:0@lo:101: 00010000:00010000:0.0:1789596651.479539:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.479546:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596651.479599:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684928:0@lo:501: 00000100:00100000:0.0:1789596651.479623:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.479644:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b66e5a43 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.479663:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984684928 00000100:00100000:1.0:1789596651.479669:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984684928 00000100:00100000:1.0:1789596651.479714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596651.479721:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf234e81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984684928:12345-0@lo:501: 00000100:00100000:1.0:1789596651.479853:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf234e81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984684928:12345-0@lo:501: Request processed in 133us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.479870:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789596651.479887:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984684928:0@lo:501: 00000100:00100000:0.0:1789596651.479917:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984685056:0@lo:503: 00000100:00100000:0.0:1789596651.479960:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.479987:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b66e5a43 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.480002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685056 00000100:00100000:1.0:1789596651.480007:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685056 00000100:00100000:1.0:1789596651.480032:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789596651.480037:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005405d168 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984685056:12345-0@lo:503: 00000100:00100000:1.0:1789596651.480115:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005405d168 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984685056:12345-0@lo:503: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.480123:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789596651.480141:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984685056:0@lo:503: 00000100:00100000:0.0:1789596651.482120:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7844:1876527984685184:0@lo:502: 00000100:00100000:0.0:1789596651.482191:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.482235:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 000000003cf08db9 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.482610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685184 00000100:00100000:1.0:1789596651.482618:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685184 00000100:00100000:1.0:1789596651.482666:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789596651.482675:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006703c98b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:7844:x1876527984685184:12345-0@lo:502: 00000100:00100000:1.0:1789596651.482855:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006703c98b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:7844:x1876527984685184:12345-0@lo:502: Request processed in 180us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.482865:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596651.482875:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7844:1876527984685184:0@lo:502: 00000020:01000000:0.0:1789596651.482909:0:7844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596651.482921:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596651.482923:0:7844:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789596651.482929:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789596651.482932:0:7844:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:0.0:1789596651.482955:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789596651.482978:0:7844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000006e53939) 00000020:00000080:0.0:1789596651.483000:0:7844:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1789596651.483008:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789596651.483097:0:7844:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789596651.483103:0:7844:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789596651.483110:0:7844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe63a 00010000:00080000:0.0:1789596651.483139:0:7844:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003edb87ae@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789596651.484693:0:7844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789596651.486415:0:7844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596651.486426:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789596651.486453:0:7844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789596651.486473:0:7844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe641 00000100:00080000:0.0:1789596651.486483:0:7844:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596651.486492:0:7844:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000003edb87ae using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596651.486523:0:7844:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000944bb1a8 x1876527984685312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596651.486546:0:7844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789596651.486617:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c522205 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984685696:0@lo:400: 00000100:00100000:0.0:1789596651.486672:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.486727:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596651.486731:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984685568:0@lo:400: 00000100:00100000:0.0:1789596651.486748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.486767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685696 00000100:00100000:0.0:1789596651.486772:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685696 00000100:00100000:0.0:1789596651.486799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596651.486803:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc807855 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984685696:12345-0@lo:400: 00000100:00100000:0.0:1789596651.486850:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc807855 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984685696:12345-0@lo:400: Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.486857:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596651.486884:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984685312:0@lo:38: 00010000:00080000:0.0:1789596651.486894:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003c522205 x1876527984685696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596651.486908:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c522205 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984685696:0@lo:400: 00000100:00100000:2.0:1789596651.486927:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1789596651.486951:0:7844:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789596651.486967:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596651.486975:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984685440:0@lo:400: 00000100:00100000:2.0:1789596651.487005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.487036:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685440 00000100:00100000:2.0:1789596651.487041:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685440 00000100:00100000:2.0:1789596651.487071:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596651.487078:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000185154a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984685440:12345-0@lo:400: 00000100:00100000:2.0:1789596651.487119:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000185154a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984685440:12345-0@lo:400: Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.487126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789596651.487145:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000055d49d3 x1876527984685440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596651.487156:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984685440:0@lo:400: 00000100:00100000:2.0:1789596651.488003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685568 00000100:00100000:2.0:1789596651.488012:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685568 00000100:00100000:2.0:1789596651.488037:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685312 00000100:00100000:2.0:1789596651.488041:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685312 00000100:00100000:2.0:1789596651.488052:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596651.488059:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053135e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984685568:12345-0@lo:400: 00000100:00100000:2.0:1789596651.488122:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053135e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984685568:12345-0@lo:400: Request processed in 63us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.488129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596651.488153:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984685568:0@lo:400: 00000100:00100000:2.0:1789596651.488158:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596651.488163:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066185e71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984685312:12345-0@lo:38: 00010000:00080000:2.0:1789596651.488188:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1789596651.488233:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe648 00000004:00100000:2.0:1789596651.488249:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789596651.488255:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1789596651.488293:0:7844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1789596651.488295:0:7847:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000074289417 x1876527984685824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1789596651.488301:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596651.488304:0:7844:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00100000:1.0:1789596651.488308:0:7847:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dcc16cb going to sleep for 0 seconds 00000020:01000000:0.0:1789596651.488308:0:7844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596651.488313:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596651.488316:0:7844:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789596651.488327:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789596651.488329:0:7844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789596651.488353:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7844:1876527984685952:0@lo:502: 00000100:00100000:0.0:1789596651.488401:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.488434:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c044ba15 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.488734:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685952 00000100:00100000:1.0:1789596651.488740:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685952 00000100:00100000:1.0:1789596651.488773:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789596651.488780:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000376b71b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:7844:x1876527984685952:12345-0@lo:502: 00000100:00100000:1.0:1789596651.488888:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000376b71b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:7844:x1876527984685952:12345-0@lo:502: Request processed in 110us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.488896:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789596651.488922:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075968194 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:7844:1876527984685952:0@lo:502: 00000020:01000000:0.0:1789596651.488951:0:7844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596651.488956:0:7844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596651.488958:0:7844:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789596651.488962:0:7844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789596651.493347:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789596651.493408:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789596651.493419:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.493432:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000071f11f56/0x7b5398e289bbe625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596651.493443:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789596651.493446:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7e88948000 from 1 10000000:01000000:2.0:1789596651.493449:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596651.493489:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.493496:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.493507:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.493530:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005871122b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984686080:0@lo:101: 00000100:00100000:2.0:1789596651.493603:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.493654:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010faed94 going to sleep for 11 seconds 00000100:00100000:0.0:1789596651.493657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686080 00000100:00100000:0.0:1789596651.493665:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686080 00000100:00100000:0.0:1789596651.493732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789596651.493741:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0641ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984686080:12345-0@lo:101: 00010000:00010000:0.0:1789596651.493756:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596651.493767:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fbfd2081/0x7b5398e289bbe656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe64f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.493791:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbfd2081/0x7b5398e289bbe656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.493803:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fbfd2081/0x7b5398e289bbe656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.493811:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fbfd2081, rc 0) 00000100:00100000:0.0:1789596651.493864:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0641ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984686080:12345-0@lo:101: Request processed in 125us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.493872:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789596651.494520:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005871122b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984686080:0@lo:101: 00010000:00010000:2.0:1789596651.494542:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.494552:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.494625:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005871122b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984686208:0@lo:501: 00000100:00100000:2.0:1789596651.494659:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.494718:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010faed94 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.495417:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686208 00000100:00100000:1.0:1789596651.495439:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686208 00000100:00100000:1.0:1789596651.495484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789596651.495493:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce00287e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984686208:12345-0@lo:501: 00000100:00100000:1.0:1789596651.495591:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce00287e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984686208:12345-0@lo:501: Request processed in 100us (932us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789596651.495600:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789596651.495619:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005871122b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984686208:0@lo:501: 10000000:01000000:0.0:1789596651.495664:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789596651.495671:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596651.495701:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000003fef80e/0x7b5398e289bbe64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789596651.511837:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000c8855139 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596651.511966:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066185e71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984685312:12345-0@lo:38: Request processed in 23800us (25038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.511978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596651.512284:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789596651.512295:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789596651.512306:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789596651.512312:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789596651.512315:0:3643:0:(import.c:65:import_set_state_nolock()) 000000003edb87ae lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789596651.512336:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008dcc16cb): req@0000000074289417 x1876527984685824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596651.512357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000944bb1a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984685312:0@lo:38: 00000100:00100000:0.0:1789596651.512439:0:7847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.512445:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596651.512460:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018ea32aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984686336:0@lo:41: 00000100:00100000:0.0:1789596651.512483:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984685824 00000100:00100000:0.0:1789596651.512491:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984685824 00000100:00100000:2.0:1789596651.512495:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596651.512515:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686336 00000100:00100000:3.0:1789596651.512528:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686336 00000100:00100000:0.0:1789596651.512535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596651.512547:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075968194 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7847:x1876527984685824:12345-0@lo:1000: 00000100:00100000:0.0:1789596651.512619:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075968194 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7847:x1876527984685824:12345-0@lo:1000: Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.512625:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596651.512639:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596651.512644:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005871122b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984686336:12345-0@lo:41: 00000004:00000024:0.0:1789596651.512664:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789596651.512760:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005871122b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984686336:12345-0@lo:41: Request processed in 116us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596651.512766:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596651.512797:0:7847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984685824:0@lo:1000: 00000100:00100000:2.0:1789596651.512836:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018ea32aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984686336:0@lo:41: 00000040:01000000:0.0:1789596651.512838:0:7847:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789596651.512874:0:7847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686464:0@lo:1000: 00000100:00100000:0.0:1789596651.512915:0:7847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.512935:0:7847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9da8b38 going to sleep for 11 seconds 00000100:00100000:3.0:1789596651.513241:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686464 00000100:00100000:3.0:1789596651.513246:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686464 00000100:00100000:3.0:1789596651.513275:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789596651.513281:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c522205 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686464:12345-0@lo:1000: 00000100:00100000:3.0:1789596651.513407:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c522205 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686464:12345-0@lo:1000: Request processed in 126us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596651.513415:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596651.513430:0:7847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686464:0@lo:1000: 00000100:00100000:0.0:1789596651.513479:0:7847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686592:0@lo:700: 00000100:00100000:0.0:1789596651.513504:0:7847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.513530:0:7847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9da8b38 going to sleep for 11 seconds 00000100:00100000:2.0:1789596651.513715:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686592 00000100:00100000:2.0:1789596651.513721:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686592 00000100:00100000:2.0:1789596651.513756:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596651.513763:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b7aaee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686592:12345-0@lo:700: 00000100:00100000:2.0:1789596651.513815:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b7aaee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686592:12345-0@lo:700: Request processed in 52us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.513821:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596651.513842:0:7847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686592:0@lo:700: 00000100:00100000:0.0:1789596651.514093:0:7847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686720:0@lo:1000: 00000100:00100000:0.0:1789596651.514120:0:7847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.514143:0:7847:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011918c55 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.514404:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686720 00000100:00100000:1.0:1789596651.514409:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686720 00000100:00100000:1.0:1789596651.514444:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596651.514451:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c6bfc9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686720:12345-0@lo:1000: 00000100:00100000:1.0:1789596651.514517:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c6bfc9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686720:12345-0@lo:1000: Request processed in 66us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.514523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596651.514548:0:7847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686720:0@lo:1000: 00000004:00080000:0.0:1789596651.514590:0:7847:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b9da8b38 with version 0 00000020:00100000:0.0:1789596651.514603:0:7847:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789596651.514609:0:7847:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000055d49d3 x1876527984686976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596651.514621:0:7847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686976:0@lo:1000: 00000100:00100000:0.0:1789596651.514644:0:7847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.514668:0:7847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7e17f15 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.515286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984686976 00000100:00100000:1.0:1789596651.515292:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984686976 00000100:00100000:1.0:1789596651.515330:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596651.515336:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000944bb1a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7847:x1876527984686976:12345-0@lo:1000: 00000001:00080000:1.0:1789596651.533801:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789596651.533815:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789596651.533959:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000944bb1a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7847:x1876527984686976:12345-0@lo:1000: Request processed in 18618us (19309us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789596651.533975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789596651.534399:0:7847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789596651.534405:0:7847:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789596651.534429:0:7847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000055d49d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984686976:0@lo:1000: 00000100:00100000:2.0:1789596651.534520:0:7847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018ea32aa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984687104:0@lo:1000: 00000100:00100000:2.0:1789596651.534565:0:7847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.534610:0:7847:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010faed94 going to sleep for 11 seconds 00000100:00100000:1.0:1789596651.537222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984687104 00000100:00100000:1.0:1789596651.537237:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984687104 00000100:00100000:1.0:1789596651.537305:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789596651.537315:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a463672c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7847:x1876527984687104:12345-0@lo:1000: 00000100:00100000:1.0:1789596651.537449:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a463672c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7847:x1876527984687104:12345-0@lo:1000: Request processed in 136us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596651.537464:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789596651.537520:0:7847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018ea32aa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7847:1876527984687104:0@lo:1000: 00000040:00080000:1.0:1789596651.537553:0:7847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789596651.537596:0:7847:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ffddf7f2 with version 1 00000040:00080000:1.0:1789596651.539716:0:7847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789596651.539808:0:7847:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789596651.539813:0:7847:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1789596651.540532:0:7845:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003cf08db9 version 1 rpc_version 1 00000020:00100000:0.0:1789596651.540571:0:7845:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789596651.540580:0:7845:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000183e2a55 x1876527984687360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596651.540602:0:7845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7845:1876527984687360:0@lo:1000: 00000100:00100000:0.0:1789596651.540669:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596651.540750:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984687360 00000100:00100000:0.0:1789596651.540758:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984687360 00000100:00100000:0.0:1789596651.540807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596651.540815:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4f7e87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7845:x1876527984687360:12345-0@lo:1000: 00000100:00100000:0.0:1789596651.540989:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040e776ff going to sleep for 11 seconds 00000001:00080000:2.0:1789596651.567305:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1789596651.567543:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4f7e87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7845:x1876527984687360:12345-0@lo:1000: Request processed in 26724us (26870us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789596651.567558:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1789596651.567651:0:7845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789596651.567655:0:7845:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789596651.567673:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7845:1876527984687360:0@lo:1000: 00000020:00000004:1.0:1789596651.889501:0:7878:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789596651.889794:0:7878:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789596651.968129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789596652.788527:0:7926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeaf7b6430 20000000:00000080:1.0:1789596652.788549:0:7926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7ebaf74400 uarg=0000000000000000 20000000:01000000:1.0:1789596652.788590:0:7926:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789596652.788597:0:7926:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789596652.788602:0:7926:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789596652.788709:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789596652.788835:0:7926:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789596652.792614:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596652.793127:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789596652.793163:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789596652.793184:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789596652.793281:0:7926:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789596652.793300:0:7926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.793320:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.793340:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.793348:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.793386:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.793399:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 17 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596652.793414:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876527984687488:0@lo:104: 00000100:00100000:1.0:1789596652.793494:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596652.793558:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.793565:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 17 pid: 6513 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596652.793573:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9e5fad0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876527984687616:0@lo:104: 00000100:00100000:1.0:1789596652.793589:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7d78236 going to sleep for 11 seconds 00000100:00100000:3.0:1789596652.793663:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789596652.793707:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596652.793864:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984687488 00000100:00100000:3.0:1789596652.793872:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984687488 00000100:00100000:3.0:1789596652.793907:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984687616 00000100:00100000:3.0:1789596652.793909:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984687616 00000100:00100000:3.0:1789596652.793922:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596652.793929:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d776372 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:7926:x1876527984687488:12345-0@lo:104: 00010000:00010000:3.0:1789596652.793940:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.793997:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596652.794003:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d776372 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:7926:x1876527984687488:12345-0@lo:104: Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596652.794010:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596652.794046:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596652.794051:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031f5544c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:7926:x1876527984687616:12345-0@lo:104: 00010000:00010000:3.0:1789596652.794057:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794083:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789596652.794092:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031f5544c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:7926:x1876527984687616:12345-0@lo:104: Request processed in 42us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596652.794097:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789596652.794112:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596652.794117:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794124:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000905543b9 already unused, calling callback (0000000042805882) 10000000:00010000:3.0:1789596652.794127:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794133:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596652.794139:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596652.794145:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596652.794168:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794174:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789596652.794281:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876527984687488:0@lo:104: 00000100:00100000:1.0:1789596652.794290:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9e5fad0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876527984687616:0@lo:104: 00010000:00010000:1.0:1789596652.794306:0:7926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794339:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794346:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000905543b9/0x7b5398e289bbe5c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5ca expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794359:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596652.794360:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794375:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072a3b09b already unused, calling callback (0000000042805882) 10000000:00010000:3.0:1789596652.794377:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794382:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596652.794387:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596652.794392:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596652.794403:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794409:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789596652.794443:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e02d4132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984687872:0@lo:103: 00000100:00100000:1.0:1789596652.794473:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596652.794510:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794517:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 0000000072a3b09b/0x7b5398e289bbe4d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe4dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794529:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596652.794530:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596652.794532:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596652.794537:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596652.794550:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017e2168b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984687744:0@lo:103: 00000100:00100000:3.0:1789596652.794570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596652.794600:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984687872 00000100:00100000:3.0:1789596652.794603:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984687872 00010000:00010000:3.0:1789596652.794621:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 18 pid: 6513 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596652.794638:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984687744 00000100:00100000:3.0:1789596652.794640:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984687744 00010000:00010000:3.0:1789596652.794646:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 19 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596652.794656:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596652.794660:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e5fad0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+19:3646:x1876527984687872:12345-0@lo:103: 00010000:00010000:3.0:1789596652.794700:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596652.794704:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 19 pid: 6513 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794712:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 19 pid: 6513 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794777:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002993969/0x7b5398e289bbe4dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe4d5 expref: 19 pid: 6513 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596652.794790:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596652.795028:0:6504:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789596652.795037:0:6504:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789596652.795175:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596652.795182:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c770eae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+18:3645:x1876527984687744:12345-0@lo:103: 00010000:00010000:2.0:1789596652.795203:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596652.795208:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 18 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795217:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 18 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795227:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c026bda3/0x7b5398e289bbe5ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe5c3 expref: 18 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795237:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795244:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795255:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795268:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795274:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795280:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795284:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000895cb348 already unused, calling callback (00000000308788ce) 00010000:00010000:2.0:1789596652.795287:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795293:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795306:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.795315:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596652.795346:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c770eae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+17:3645:x1876527984687744:12345-0@lo:103: Request processed in 165us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596652.795352:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596652.796294:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e5fad0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+16:3646:x1876527984687872:12345-0@lo:103: Request processed in 1627us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596652.796304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596652.796355:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017e2168b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984687744:0@lo:103: 00000100:00100000:1.0:1789596652.796407:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e02d4132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984687872:0@lo:103: 00010000:00010000:1.0:1789596652.796432:0:7926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.796442:0:7926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596652.796447:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000895cb348/0x7b5398e289bbe65d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596652.989224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596653.501027:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596653.501052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984688000:0@lo:41: 00000100:00100000:2.0:1789596653.501118:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596653.501310:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688000 00000100:00100000:0.0:1789596653.501319:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688000 00000100:00100000:0.0:1789596653.501359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596653.501367:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048600549 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984688000:12345-0@lo:41: 00000004:00000024:0.0:1789596653.501400:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789596653.501472:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048600549 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984688000:12345-0@lo:41: Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596653.501477:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596653.501524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074289417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984688000:0@lo:41: 00010000:00010000:3.0:1789596654.012806:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596655.048393:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596656.062233:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596656.573294:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596656.573320:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f0e8fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984688128:0@lo:41: 00000100:00100000:1.0:1789596656.573394:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596656.573646:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688128 00000100:00100000:1.0:1789596656.573655:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688128 00000100:00100000:0.0:1789596656.574234:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc8fd84b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984688256:0@lo:400: 00000100:00100000:0.0:1789596656.574276:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596656.574369:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789596656.574379:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bc9be43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984688128:12345-0@lo:41: 00000004:00000024:1.0:1789596656.574417:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789596656.575089:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bc9be43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984688128:12345-0@lo:41: Request processed in 710us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596656.575097:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596656.575278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f0e8fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984688128:0@lo:41: 00000100:00100000:0.0:1789596656.575293:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596656.575299:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984688640:0@lo:400: 00000100:00100000:0.0:1789596656.575329:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596656.575402:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688256 00000100:00100000:0.0:1789596656.575407:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688256 00000100:00100000:0.0:1789596656.575446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596656.575452:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd165f47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:3645:x1876527984688256:12345-0@lo:400: 00000100:00100000:0.0:1789596656.575495:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd165f47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:3645:x1876527984688256:12345-0@lo:400: Request processed in 44us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596656.575502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596656.575530:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc8fd84b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984688256:0@lo:400: 00000100:00100000:2.0:1789596656.580177:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000838196b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984688384:0@lo:400: 00000100:00100000:2.0:1789596656.580280:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596656.580896:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596656.580905:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984688512:0@lo:400: 00000100:00100000:2.0:1789596656.580935:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596656.581194:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688512 00000100:00100000:1.0:1789596656.581203:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688512 00000100:00100000:1.0:1789596656.581261:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789596656.581269:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b31e6c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984688512:12345-0@lo:400: 00000100:00100000:1.0:1789596656.581336:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b31e6c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984688512:12345-0@lo:400: Request processed in 67us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596656.581355:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789596656.581395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984688512:0@lo:400: 00000100:00100000:3.0:1789596656.584839:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688640 00000100:00100000:3.0:1789596656.584855:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688640 00000100:00100000:3.0:1789596656.586179:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688384 00000100:00100000:3.0:1789596656.586189:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688384 00000100:00100000:0.0:1789596656.586641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596656.586652:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060159d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984688640:12345-0@lo:400: 00000100:00100000:0.0:1789596656.586768:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060159d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984688640:12345-0@lo:400: Request processed in 118us (11438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596656.586775:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596656.586791:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596656.586796:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000686e0f94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984688384:12345-0@lo:400: 00000100:00100000:0.0:1789596656.586831:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000686e0f94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984688384:12345-0@lo:400: Request processed in 36us (6552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596656.586836:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789596656.589811:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000838196b4 x1876527984688384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596656.589830:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000838196b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984688384:0@lo:400: 00010000:00080000:0.0:1789596656.589877:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dada4c97 x1876527984688640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596656.589886:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984688640:0@lo:400: 00010000:00010000:3.0:1789596657.084854:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596658.110009:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596658.621918:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596658.621944:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041c97a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984688768:0@lo:41: 00000100:00100000:1.0:1789596658.622027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596658.622093:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688768 00000100:00100000:1.0:1789596658.622102:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688768 00000100:00100000:1.0:1789596658.622157:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596658.622165:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035d0d70b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984688768:12345-0@lo:41: 00000004:00000024:1.0:1789596658.622196:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789596658.622236:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035d0d70b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984688768:12345-0@lo:41: Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596658.622242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596658.622294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041c97a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984688768:0@lo:41: 10000000:01000000:0.0:1789596659.139948:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789596659.139959:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb9a66000 from 1 10000000:01000000:0.0:1789596659.139966:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789596659.140104:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000fdf2a857/0x7b5398e289bbe664 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596659.140120:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000fdf2a857/0x7b5398e289bbe664 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596659.140142:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000fdf2a857/0x7b5398e289bbe664 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596659.140186:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984688896:0@lo:101: 00000100:00100000:0.0:1789596659.140271:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596659.140328:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c09a1f78 going to sleep for 11 seconds 00010000:00010000:0.0:1789596659.140351:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596659.140539:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984688896 00000100:00100000:3.0:1789596659.140550:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984688896 00000100:00100000:3.0:1789596659.140607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789596659.140616:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b09e858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984688896:12345-0@lo:101: 00010000:00010000:3.0:1789596659.140633:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596659.140649:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072a3b09b/0x7b5398e289bbe66b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe664 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.140695:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072a3b09b/0x7b5398e289bbe66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.140709:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072a3b09b/0x7b5398e289bbe66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.140719:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072a3b09b, rc 0) 00000100:00100000:3.0:1789596659.140765:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b09e858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984688896:12345-0@lo:101: Request processed in 150us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.140772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596659.141243:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984688896:0@lo:101: 00010000:00010000:0.0:1789596659.141262:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000fdf2a857/0x7b5398e289bbe664 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596659.141271:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000fdf2a857/0x7b5398e289bbe664 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596659.141351:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689024:0@lo:501: 00000100:00100000:0.0:1789596659.141385:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596659.142325:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c09a1f78 going to sleep for 11 seconds 00000100:00100000:3.0:1789596659.144840:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689024 00000100:00100000:3.0:1789596659.144858:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689024 00000100:00100000:3.0:1789596659.144936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789596659.144947:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000628177fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984689024:12345-0@lo:501: 00000100:00100000:3.0:1789596659.147525:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000628177fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984689024:12345-0@lo:501: Request processed in 2566us (6125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.147545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789596659.150197:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183e2a55 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689024:0@lo:501: 00000100:00100000:2.0:1789596659.150287:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689152:0@lo:503: 00000100:00100000:2.0:1789596659.150385:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596659.150433:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ba53654 going to sleep for 11 seconds 00000100:00100000:1.0:1789596659.152226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689152 00000100:00100000:1.0:1789596659.152249:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689152 00000100:00100000:1.0:1789596659.152334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789596659.152346:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009bdb661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984689152:12345-0@lo:503: 00000100:00100000:1.0:1789596659.152665:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009bdb661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984689152:12345-0@lo:503: Request processed in 320us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596659.152675:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789596659.155141:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689152:0@lo:503: 00000100:00100000:2.0:1789596659.157444:0:8253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8253:1876527984689280:0@lo:502: 00000100:00100000:2.0:1789596659.157546:0:8253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596659.157598:0:8253:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2398e43 going to sleep for 11 seconds 00000100:00100000:3.0:1789596659.161522:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689280 00000100:00100000:3.0:1789596659.161544:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689280 00000100:00100000:3.0:1789596659.161610:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789596659.161621:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe7f1ff6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:8253:x1876527984689280:12345-0@lo:502: 00000100:00100000:3.0:1789596659.161867:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe7f1ff6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:8253:x1876527984689280:12345-0@lo:502: Request processed in 247us (4321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.161941:0:8253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dada4c97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8253:1876527984689280:0@lo:502: 00000020:01000000:2.0:1789596659.161995:0:8253:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596659.162007:0:8253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596659.162010:0:8253:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789596659.162019:0:8253:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7eb9a66000 00000020:00000080:2.0:1789596659.162022:0:8253:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789596659.162042:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789596659.162091:0:8253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8253:1876527984689408:0@lo:502: 00000100:00100000:2.0:1789596659.162156:0:8253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596659.162207:0:8253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596659.162210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689408 00000100:00100000:3.0:1789596659.162214:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689408 00000100:00100000:3.0:1789596659.162239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789596659.162247:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:8253:x1876527984689408:12345-0@lo:502: 00000100:00100000:3.0:1789596659.162323:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:8253:x1876527984689408:12345-0@lo:502: Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.162331:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789596659.163212:0:8253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8253:1876527984689408:0@lo:502: 00000020:01000000:2.0:1789596659.163249:0:8253:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596659.163257:0:8253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596659.163259:0:8253:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789596659.163264:0:8253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789596659.163408:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789596659.163447:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596659.163459:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.163473:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596659.163485:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789596659.163488:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e867d5800 from 1 10000000:01000000:3.0:1789596659.163491:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596659.163523:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.163531:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.163541:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596659.163569:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689536:0@lo:101: 00000100:00100000:3.0:1789596659.163621:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.163659:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351540 going to sleep for 11 seconds 00000100:00100000:2.0:1789596659.164774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689536 00000100:00100000:2.0:1789596659.164790:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689536 00000100:00100000:2.0:1789596659.164862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596659.164874:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984689536:12345-0@lo:101: 00010000:00010000:2.0:1789596659.164895:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596659.166160:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe672 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596659.166213:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596659.166228:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596659.166239:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510e00, rc 0) 00000100:00100000:2.0:1789596659.166338:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984689536:12345-0@lo:101: Request processed in 1464us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.166348:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789596659.166481:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689536:0@lo:101: 00010000:00010000:3.0:1789596659.166506:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596659.166518:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596659.166621:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689664:0@lo:501: 00000100:00100000:3.0:1789596659.166660:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.166729:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351540 going to sleep for 11 seconds 00000100:00100000:1.0:1789596659.167533:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689664 00000100:00100000:1.0:1789596659.167546:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689664 00000100:00100000:1.0:1789596659.167616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789596659.167629:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984689664:12345-0@lo:501: 00000100:00100000:1.0:1789596659.167839:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984689664:12345-0@lo:501: Request processed in 212us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596659.167848:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789596659.167900:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689664:0@lo:501: 00000100:00100000:1.0:1789596659.169193:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689792:0@lo:503: 00000100:00100000:1.0:1789596659.169273:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596659.169312:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92a73e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596659.169457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689792 00000100:00100000:2.0:1789596659.169466:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689792 00000100:00100000:2.0:1789596659.169520:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789596659.169531:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984689792:12345-0@lo:503: 00000100:00100000:2.0:1789596659.169664:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984689792:12345-0@lo:503: Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.169671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789596659.172417:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984689792:0@lo:503: 00000100:00100000:3.0:1789596659.173267:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8255:1876527984689920:0@lo:502: 00000100:00100000:3.0:1789596659.173361:0:8255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.173418:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596659.173476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984689920 00000100:00100000:1.0:1789596659.173484:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984689920 00000100:00100000:1.0:1789596659.173548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789596659.173561:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:8255:x1876527984689920:12345-0@lo:502: 00000100:00100000:1.0:1789596659.173770:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:8255:x1876527984689920:12345-0@lo:502: Request processed in 211us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596659.173778:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596659.173940:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8255:1876527984689920:0@lo:502: 00000020:01000000:3.0:1789596659.173975:0:8255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596659.173988:0:8255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596659.173991:0:8255:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789596659.174000:0:8255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7e867d5800 00000020:00000080:3.0:1789596659.174003:0:8255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789596659.174041:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8255:1876527984690048:0@lo:502: 00000100:00100000:3.0:1789596659.174082:0:8255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.174122:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596659.174308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690048 00000100:00100000:1.0:1789596659.174313:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690048 00000100:00100000:1.0:1789596659.174350:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789596659.174358:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:8255:x1876527984690048:12345-0@lo:502: 00000100:00100000:1.0:1789596659.174431:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:8255:x1876527984690048:12345-0@lo:502: Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596659.174438:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789596659.174611:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8255:1876527984690048:0@lo:502: 00000020:01000000:3.0:1789596659.174632:0:8255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596659.174637:0:8255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596659.174639:0:8255:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789596659.174643:0:8255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789596659.174858:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789596659.174885:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596659.174898:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596659.174923:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596660.157281:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596661.180980:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596661.693806:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596661.693837:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984690176:0@lo:41: 00000100:00100000:0.0:1789596661.694079:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984690432:0@lo:400: 00000100:00100000:3.0:1789596661.694184:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984690688:0@lo:400: 00000100:00100000:0.0:1789596661.699446:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596661.699547:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596661.699562:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984690560:0@lo:400: 00000100:00100000:0.0:1789596661.699604:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596661.699670:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690432 00000100:00100000:0.0:1789596661.699696:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690432 00000100:00100000:0.0:1789596661.699758:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596661.699768:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984690432:12345-0@lo:400: 00000100:00100000:0.0:1789596661.699834:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984690432:12345-0@lo:400: Request processed in 67us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596661.699842:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596661.700124:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690560 00000100:00100000:0.0:1789596661.700130:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690560 00000100:00100000:0.0:1789596661.700162:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789596661.700170:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984690560:12345-0@lo:400: 00000100:00100000:0.0:1789596661.700209:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984690560:12345-0@lo:400: Request processed in 41us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596661.700216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789596661.700266:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984690560:0@lo:400: 00010000:00080000:0.0:1789596661.700282:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7eb0c17800 x1876527984690432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596661.700293:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984690432:0@lo:400: 00000100:00100000:2.0:1789596661.701042:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596661.701145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984690304:0@lo:400: 00000100:00100000:2.0:1789596661.701205:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596661.701235:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690304 00000100:00100000:2.0:1789596661.701240:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690304 00000100:00100000:2.0:1789596661.701284:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789596661.701293:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:3647:x1876527984690304:12345-0@lo:400: 00000100:00100000:2.0:1789596661.701336:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:3647:x1876527984690304:12345-0@lo:400: Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596661.701344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789596661.701394:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984690304:0@lo:400: 00000100:00100000:2.0:1789596661.701402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984690816:0@lo:400: 00000100:00100000:2.0:1789596661.701425:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596661.701625:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690176 00000100:00100000:0.0:1789596661.701630:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690176 00000100:00100000:0.0:1789596661.701653:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690816 00000100:00100000:0.0:1789596661.701656:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690816 00000100:00100000:0.0:1789596661.701668:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596661.701674:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984690176:12345-0@lo:41: 00000004:00000024:0.0:1789596661.701774:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789596661.701825:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984690176:12345-0@lo:41: Request processed in 151us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596661.701831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596661.701843:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596661.701849:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984690816:12345-0@lo:400: 00000100:00100000:0.0:1789596661.701877:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984690816:12345-0@lo:400: Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596661.702647:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596661.702741:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984690816:0@lo:400: 00000100:00100000:0.0:1789596661.702772:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984690176:0@lo:41: 00000100:00100000:3.0:1789596661.703384:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596661.703628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690688 00000100:00100000:0.0:1789596661.703637:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690688 00000100:00100000:0.0:1789596661.703781:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596661.703791:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984690688:12345-0@lo:400: 00000100:00100000:0.0:1789596661.703860:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984690688:12345-0@lo:400: Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596661.703868:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789596661.704520:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb025500 x1876527984690688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596661.704538:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984690688:0@lo:400: 00010000:00010000:0.0:1789596662.212084:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789596663.101886:0:8428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789596663.101890:0:8428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789596663.101891:0:8428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789596663.102037:0:8428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7ebaf79000 00000020:01000004:3.0:1789596663.102052:0:8428:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789596663.102065:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789596663.102080:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c7eb98bcd40) 00000020:00000080:3.0:1789596663.102108:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789596663.137763:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789596663.137852:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789596663.160065:0:8428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789596663.160333:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789596663.160345:0:8428:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789596663.160357:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7b5398e289bbe687 00000020:01000004:3.0:1789596663.160364:0:8428:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789596663.160384:0:8428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789596663.160388:0:8428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789596663.160393:0:8428:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789596663.160398:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789596663.160419:0:8428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c7ebb18cd40) 00000020:00000080:3.0:1789596663.160432:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789596663.162918:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596663.163245:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789596663.163258:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789596663.177696:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789596663.177949:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789596663.183460:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596663.183472:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789596663.185596:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596663.185813:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789596663.185818:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789596663.187600:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789596663.187613:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789596663.211392:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596663.211674:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789596663.211792:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789596663.213532:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596663.213542:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789596663.215298:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596663.215310:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789596663.218165:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596663.218365:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789596663.218371:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789596663.219242:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789596663.219252:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1789596663.229153:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596663.258890:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596663.259186:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789596663.259194:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789596663.260358:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789596663.260367:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789596663.260836:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789596663.260865:0:8428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789596663.260872:0:8428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789596663.275581:0:8428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789596663.275624:0:8428:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789596663.275628:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789596663.275630:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789596663.275631:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596663.275632:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596663.276060:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596663.276061:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596663.276063:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596663.276064:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596663.276066:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596663.276067:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596663.276069:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789596663.276073:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789596663.276075:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789596663.276076:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789596663.276077:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596663.276078:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596663.276079:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596663.276079:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596663.276080:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596663.276081:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596663.276082:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596663.276083:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596663.276084:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789596663.276121:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789596663.276140:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984690944:0@lo:253: 00000100:00100000:0.0:1789596663.276213:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.276308:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b04900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596663.276354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984690944 00000100:00100000:3.0:1789596663.276364:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984690944 00000100:00100000:3.0:1789596663.276418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596663.276428:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:8428:x1876527984690944:12345-0@lo:253: 20000000:01000000:3.0:1789596663.276457:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789596663.276461:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789596663.276466:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789596663.276469:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789596663.277627:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596663.277879:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789596663.277894:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789596663.277911:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789596663.278144:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789596663.278158:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789596663.278166:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789596663.278233:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789596663.278246:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:3.0:1789596663.278248:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:3.0:1789596663.278255:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789596663.278258:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789596663.278266:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789596663.278269:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:3.0:1789596663.278275:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789596663.278279:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789596663.278286:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789596663.278293:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789596663.278342:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789596663.278352:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:3.0:1789596663.278353:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:3.0:1789596663.278367:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789596663.278380:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789596663.278390:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789596663.278393:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:3.0:1789596663.278399:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789596663.278402:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789596663.278409:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789596663.278427:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789596663.278975:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789596663.278985:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:3.0:1789596663.278986:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:3.0:1789596663.278995:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789596663.278998:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789596663.279005:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789596663.279008:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:3.0:1789596663.279014:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789596663.279017:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789596663.279024:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789596663.279031:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789596663.279040:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789596663.279043:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789596663.279047:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789596663.279112:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789596663.279114:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596663.279454:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596663.279476:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596663.279493:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789596663.279902:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789596663.279992:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789596663.280011:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789596663.280022:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789596663.280024:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789596663.280433:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789596663.280463:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789596663.280479:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789596663.280652:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789596663.280674:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789596663.280845:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789596663.280856:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789596663.280858:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789596663.281188:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789596663.281213:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789596663.281229:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789596663.281379:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789596663.281398:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789596663.281413:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789596663.281423:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789596663.281424:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789596663.281866:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789596663.282052:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789596663.282069:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789596663.282083:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1789596663.282108:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789596663.282127:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282145:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282167:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282175:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282181:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282188:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282195:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282231:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282245:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.282259:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691072:0@lo:104: 00000100:00100000:1.0:1789596663.282324:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596663.282402:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282410:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 18 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.282419:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691200:0@lo:104: 00000100:00100000:1.0:1789596663.282442:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596663.282513:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.282521:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 18 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.282529:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691328:0@lo:104: 00000100:00100000:1.0:1789596663.282546:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.282587:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691072 00000100:00100000:0.0:1789596663.282594:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691072 00000100:00100000:0.0:1789596663.282630:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691200 00000100:00100000:0.0:1789596663.282632:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691200 00000100:00100000:0.0:1789596663.282644:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596663.282653:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6513:x1876527984691072:12345-0@lo:104: 00010000:00010000:0.0:1789596663.282666:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.282735:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596663.282745:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6513:x1876527984691072:12345-0@lo:104: Request processed in 94us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.282752:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596663.282768:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596663.282773:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6513:x1876527984691200:12345-0@lo:104: 00010000:00010000:0.0:1789596663.282781:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.282809:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789596663.282814:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6513:x1876527984691200:12345-0@lo:104: Request processed in 41us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.282819:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789596663.282833:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596663.282839:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.282846:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1789596663.282850:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.282858:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596663.282865:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596663.282871:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596663.282901:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.283004:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596663.283010:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.283017:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596663.283020:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.283027:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596663.283034:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596663.283045:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596663.283060:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.283065:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596663.283081:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.283088:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe62c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.283112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596663.283113:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596663.283115:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596663.283137:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596663.283145:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.283151:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe64f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe656 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.283162:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596663.283163:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596663.283165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596663.283176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984691584:0@lo:103: 00000100:00100000:0.0:1789596663.283202:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.283261:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596663.283266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984691456:0@lo:103: 00000100:00100000:0.0:1789596663.283284:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596663.283349:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.283357:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 18 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.283366:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691712:0@lo:104: 00000100:00100000:1.0:1789596663.283396:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596663.283418:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.283426:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.283434:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691840:0@lo:104: 00000100:00100000:1.0:1789596663.283450:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.283458:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e84f163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.283476:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691072:0@lo:104: 00000100:00100000:1.0:1789596663.283484:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691200:0@lo:104: 00000100:00100000:3.0:1789596663.283539:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691328 00000100:00100000:3.0:1789596663.283544:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691328 00000100:00100000:3.0:1789596663.283565:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691712 00000100:00100000:3.0:1789596663.283567:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691712 00000100:00100000:3.0:1789596663.283574:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691840 00000100:00100000:3.0:1789596663.283576:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691840 00000100:00100000:3.0:1789596663.283586:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596663.283592:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+5:6513:x1876527984691328:12345-0@lo:104: 00010000:00010000:3.0:1789596663.283600:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283644:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596663.283648:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+5:6513:x1876527984691328:12345-0@lo:104: Request processed in 57us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.283654:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596663.283665:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596663.283670:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6513:x1876527984691712:12345-0@lo:104: 00010000:00010000:3.0:1789596663.283692:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283719:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789596663.283723:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6513:x1876527984691712:12345-0@lo:104: Request processed in 53us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.283729:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596663.283738:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596663.283742:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6513:x1876527984691840:12345-0@lo:104: 00010000:00010000:3.0:1789596663.283754:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283780:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789596663.283785:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6513:x1876527984691840:12345-0@lo:104: Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.283790:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789596663.283803:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789596663.283808:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283815:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596663.283818:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283825:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596663.283832:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596663.283837:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596663.283852:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283857:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596663.283870:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283877:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81671c00/0x7b5398e289bbe609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283892:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596663.283895:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283901:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbc00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596663.283904:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283910:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596663.283926:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596663.283932:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596663.283944:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283949:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596663.283954:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283961:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbe5d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe5d8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283968:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596663.283971:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283985:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596663.283988:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.283995:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596663.284000:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596663.284006:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596663.284015:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.284021:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596663.284025:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.284031:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe55a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe561 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.284043:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596663.284044:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596663.284046:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596663.284051:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596663.284055:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596663.284160:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984691968:0@lo:103: 00000100:00100000:1.0:1789596663.284198:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691328:0@lo:104: 00000100:00100000:1.0:1789596663.284205:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691712:0@lo:104: 00000100:00100000:1.0:1789596663.284210:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876527984691840:0@lo:104: 00010000:00010000:1.0:1789596663.284232:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596663.284371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984692224:0@lo:103: 00000100:00100000:0.0:1789596663.284391:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596663.284478:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691584 00000100:00100000:2.0:1789596663.284483:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691584 00010000:00010000:2.0:1789596663.284504:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 19 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596663.284530:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691456 00000100:00100000:2.0:1789596663.284532:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691456 00010000:00010000:2.0:1789596663.284542:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 20 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596663.284556:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596663.284562:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+20:3644:x1876527984691584:12345-0@lo:103: 00010000:00010000:2.0:1789596663.284572:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596663.284577:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 20 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.284595:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 20 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.284608:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe62c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe625 expref: 20 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.284620:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596663.284644:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+19:3644:x1876527984691584:12345-0@lo:103: Request processed in 82us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.284650:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596663.284662:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596663.284667:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+18:3644:x1876527984691456:12345-0@lo:103: 00010000:00010000:2.0:1789596663.285030:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596663.285036:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.285045:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.285054:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe64f expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.285064:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596663.285086:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+17:3644:x1876527984691456:12345-0@lo:103: Request processed in 419us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.285092:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596663.285229:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984691456:0@lo:103: 00000100:00100000:0.0:1789596663.285238:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984691584:0@lo:103: 00000100:00100000:0.0:1789596663.285263:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984692096:0@lo:103: 00000100:00100000:0.0:1789596663.285289:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.285424:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596663.285472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692224 00000100:00100000:3.0:1789596663.285477:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692224 00010000:00010000:3.0:1789596663.285496:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 17 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596663.285526:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692096 00000100:00100000:3.0:1789596663.285529:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692096 00010000:00010000:3.0:1789596663.285540:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 18 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596663.285553:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596663.285560:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+18:3644:x1876527984692224:12345-0@lo:103: 00010000:00010000:3.0:1789596663.285566:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596663.285570:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.285578:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.285586:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030e00/0x7b5398e289bbe561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe55a expref: 18 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.285595:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596663.285619:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+17:3644:x1876527984692224:12345-0@lo:103: Request processed in 61us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.285624:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596663.285635:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596663.285640:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+16:3647:x1876527984692096:12345-0@lo:103: 00010000:00010000:3.0:1789596663.285646:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596663.285649:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 16 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.285656:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 16 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.285670:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe5d1 expref: 16 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.285693:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596663.285716:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+15:3647:x1876527984692096:12345-0@lo:103: Request processed in 77us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.285722:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596663.285916:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984692096:0@lo:103: 00000100:00100000:0.0:1789596663.285948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984692224:0@lo:103: 00000100:00100000:3.0:1789596663.286045:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984691968 00000100:00100000:3.0:1789596663.286049:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984691968 00010000:00010000:3.0:1789596663.286063:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 15 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596663.286087:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596663.286101:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e91848050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+15:3646:x1876527984691968:12345-0@lo:103: 00010000:00010000:3.0:1789596663.286120:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596663.286125:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 15 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286133:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 15 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286142:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbe610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe609 expref: 15 pid: 6512 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286152:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286159:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286181:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286188:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286195:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286200:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286205:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596663.286209:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286217:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286233:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.286242:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596663.286268:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e91848050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+14:3646:x1876527984691968:12345-0@lo:103: Request processed in 175us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.286274:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596663.286352:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984691968:0@lo:103: 00010000:00010000:1.0:1789596663.286401:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.286409:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.286414:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe695 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789596663.286425:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789596663.294064:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+13:8428:x1876527984690944:12345-0@lo:253: Request processed in 17628us (17841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.294080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789596663.294310:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984690944:0@lo:253: 10000000:01000000:2.0:1789596663.294327:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789596663.294346:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596663.294347:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789596663.294349:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596663.294350:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789596663.294351:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596663.294353:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596663.294354:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596663.294356:0:8428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789596663.294357:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596663.294358:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596663.294383:0:8428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7ebaf79000 from lustre-OST0000 10000000:01000000:2.0:1789596663.294415:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789596663.294418:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789596663.294427:0:8428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7e88948000 local copy 10000000:01000000:2.0:1789596663.294431:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596663.294470:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.294481:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.294489:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596663.294507:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692352:0@lo:101: 00000100:00100000:2.0:1789596663.294544:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596663.294594:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b04900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.294907:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692352 00000100:00100000:1.0:1789596663.294925:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692352 00000100:00100000:1.0:1789596663.294962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789596663.294971:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+13:8428:x1876527984692352:12345-0@lo:101: 00010000:00010000:1.0:1789596663.294986:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596663.294998:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe69c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.295020:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe69c expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.295037:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe69c expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.295047:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671400, rc 0) 00000100:00100000:1.0:1789596663.295082:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984692352:12345-0@lo:101: Request processed in 112us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.295088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596663.295201:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692352:0@lo:101: 00010000:00010000:0.0:1789596663.295215:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.295224:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596663.295320:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692480:0@lo:501: 00000100:00100000:0.0:1789596663.295348:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.295373:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596663.295907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692480 00000100:00100000:2.0:1789596663.295913:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692480 00000100:00100000:2.0:1789596663.295963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789596663.295971:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984692480:12345-0@lo:501: 00000100:00100000:2.0:1789596663.296042:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984692480:12345-0@lo:501: Request processed in 72us (693us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596663.296062:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789596663.296152:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692480:0@lo:501: 10000000:01000000:0.0:1789596663.296166:0:8428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789596663.296184:0:8428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789596663.296190:0:8428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.296199:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.296206:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.296231:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789596663.296255:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7ebaf79000 10000000:01000000:0.0:1789596663.296260:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789596663.296264:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789596663.296273:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789596663.296278:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789596663.296280:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596663.296298:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.296306:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.296314:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596663.296327:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692608:0@lo:101: 00000100:00100000:0.0:1789596663.296354:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.296372:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596663.296532:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692608 00000100:00100000:2.0:1789596663.296536:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692608 00000100:00100000:2.0:1789596663.296567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789596663.296573:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984692608:12345-0@lo:101: 00010000:00010000:2.0:1789596663.296580:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596663.296590:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe6aa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296605:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296625:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296633:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510800, rc 0) 00000100:00100000:2.0:1789596663.296662:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984692608:12345-0@lo:101: Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.296668:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:2.0:1789596663.296718:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596663.296724:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296732:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596663.296736:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296744:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596663.296762:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596663.296767:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596663.296782:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296786:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596663.296798:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296802:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511400/0x7b5398e289bbe69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe6a3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.296811:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596663.296813:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596663.296814:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596663.296912:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596663.296932:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984692736:0@lo:103: 00000100:00100000:0.0:1789596663.296962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.297007:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692608:0@lo:101: 00010000:00010000:0.0:1789596663.297018:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.297026:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596663.297080:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692864:0@lo:501: 00000100:00100000:0.0:1789596663.297114:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.297125:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed840 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.297214:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692864 00000100:00100000:1.0:1789596663.297218:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692864 00000100:00100000:1.0:1789596663.297243:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789596663.297248:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984692864:12345-0@lo:501: 00000100:00100000:1.0:1789596663.297325:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984692864:12345-0@lo:501: Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.297331:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789596663.297363:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692864:0@lo:501: 00000100:00100000:1.0:1789596663.297389:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692992:0@lo:503: 00000100:00100000:1.0:1789596663.297427:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.297444:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e993529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.297452:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692992 00000100:00100000:1.0:1789596663.297455:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692992 00000100:00100000:1.0:1789596663.297470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789596663.297476:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984692992:12345-0@lo:503: 00000100:00100000:1.0:1789596663.297546:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984692992:12345-0@lo:503: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.297552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789596663.297595:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984692992:0@lo:503: 00000100:00100000:2.0:1789596663.297715:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984692736 00000100:00100000:2.0:1789596663.297718:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984692736 00000100:00100000:2.0:1789596663.297743:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596663.297747:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+15:3644:x1876527984692736:12345-0@lo:103: 00010000:00010000:2.0:1789596663.297753:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596663.297762:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe69c expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.297770:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596663.297796:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+14:3644:x1876527984692736:12345-0@lo:103: Request processed in 48us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.297802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:1.0:1789596663.298204:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596663.298261:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693120:0@lo:502: 00000100:00100000:1.0:1789596663.298285:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.298296:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.298307:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693120 00000100:00100000:1.0:1789596663.298310:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693120 00000100:00100000:1.0:1789596663.298327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596663.298333:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984693120:12345-0@lo:502: 00000100:00100000:1.0:1789596663.298404:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984693120:12345-0@lo:502: Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.298411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596663.298444:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693120:0@lo:502: 00000040:00080000:1.0:1789596663.298611:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000100:00100000:0.0:1789596663.298727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984692736:0@lo:103: 00000040:00080000:1.0:1789596663.298904:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789596663.298973:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789596663.298985:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789596663.298992:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789596663.298999:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789596663.299013:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693248:0@lo:502: 00000100:00100000:1.0:1789596663.299040:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.299090:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596663.299241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693248 00000100:00100000:0.0:1789596663.299245:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693248 00000100:00100000:0.0:1789596663.299296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789596663.299301:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984693248:12345-0@lo:502: 00000100:00100000:0.0:1789596663.299383:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984693248:12345-0@lo:502: Request processed in 81us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.299390:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789596663.299450:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693248:0@lo:502: 00000040:00080000:2.0:1789596663.299496:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789596663.299504:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789596663.299890:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596663.299898:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789596663.299904:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596663.299906:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789596663.299911:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596663.299943:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c7d820ccd40) 00000020:00000080:2.0:1789596663.299966:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789596663.299973:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789596663.300057:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebaf79000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789596663.300066:0:8451:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789596663.300073:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7b5398e289bbe6bf 00010000:00010000:2.0:1789596663.303539:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789596663.304023:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789596663.306477:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789596663.307195:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789596663.319546:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789596663.320277:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789596663.326545:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789596663.332308:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789596663.332321:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596663.332328:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596663.332330:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789596663.332334:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596663.332338:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596663.332340:0:8451:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596663.332342:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596663.332344:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789596663.332372:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596663.332375:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596663.332382:0:8451:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789596663.332386:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789596663.332548:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789596663.332580:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789596663.332607:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.332642:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596663.332651:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebaf79000 from 1 10000000:01000000:3.0:1789596663.332654:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596663.332729:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.332738:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.332750:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596663.332772:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693376:0@lo:101: 00000100:00100000:3.0:1789596663.332843:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596663.332879:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596663.333029:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693376 00000100:00100000:2.0:1789596663.333036:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693376 00000100:00100000:2.0:1789596663.333087:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789596663.333107:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:8428:x1876527984693376:12345-0@lo:101: 00010000:00010000:2.0:1789596663.333120:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596663.333133:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe6c6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.333155:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.333165:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.333175:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81511400, rc 0) 00000100:00100000:2.0:1789596663.333215:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693376:12345-0@lo:101: Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.333221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789596663.333591:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693376:0@lo:101: 00010000:00010000:3.0:1789596663.333606:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.333701:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596663.333794:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693504:0@lo:501: 00000100:00100000:3.0:1789596663.333823:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596663.333848:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596663.334742:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693504 00000100:00100000:0.0:1789596663.334750:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693504 00000100:00100000:0.0:1789596663.334791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789596663.334800:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693504:12345-0@lo:501: 00000100:00100000:0.0:1789596663.334925:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693504:12345-0@lo:501: Request processed in 126us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.334932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789596663.334966:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693504:0@lo:501: 00000100:00100000:0.0:1789596663.335000:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693632:0@lo:503: 00000100:00100000:0.0:1789596663.335041:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.335059:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596663.335080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693632 00000100:00100000:0.0:1789596663.335084:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693632 00000100:00100000:0.0:1789596663.335110:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596663.335116:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693632:12345-0@lo:503: 00000100:00100000:0.0:1789596663.335192:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693632:12345-0@lo:503: Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.335199:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596663.335234:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693632:0@lo:503: 00000040:00080000:0.0:1789596663.335472:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789596663.335529:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693760:0@lo:502: 00000100:00100000:0.0:1789596663.335563:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.335573:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92affe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596663.335591:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693760 00000100:00100000:0.0:1789596663.335595:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693760 00000100:00100000:0.0:1789596663.335611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789596663.335616:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693760:12345-0@lo:502: 00000100:00100000:0.0:1789596663.336885:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693760:12345-0@lo:502: Request processed in 1264us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.336895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789596663.336990:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693760:0@lo:502: 00000040:00080000:2.0:1789596663.337200:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789596663.337228:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789596663.337256:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693888:0@lo:502: 00000100:00100000:2.0:1789596663.337297:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596663.337332:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596663.337376:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984693888 00000100:00100000:3.0:1789596663.337381:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984693888 00000100:00100000:3.0:1789596663.337421:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789596663.337429:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693888:12345-0@lo:502: 00000100:00100000:3.0:1789596663.337525:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984693888:12345-0@lo:502: Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.337532:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789596663.337752:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984693888:0@lo:502: 00000040:00080000:2.0:1789596663.337788:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789596663.337802:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789596663.338973:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596663.338985:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596663.338988:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789596663.338995:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7ebaf79000 00000020:00000080:2.0:1789596663.338998:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596663.339009:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596663.339012:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596663.339013:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789596663.339015:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789596663.339159:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789596663.339185:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596663.339234:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.339245:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596663.339307:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789596663.339310:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7ebaf79000 10000000:01000000:0.0:1789596663.339313:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7ebaf79000 10000000:01000000:0.0:1789596663.339316:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789596663.339323:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7ebaf79000 from 1 10000000:01000000:0.0:1789596663.339326:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596663.339359:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.339368:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.339384:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596663.339404:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694016:0@lo:101: 00000100:00100000:0.0:1789596663.339459:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.339496:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652540 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.339550:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694016 00000100:00100000:1.0:1789596663.339556:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694016 00000100:00100000:1.0:1789596663.339596:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789596663.339605:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8428:x1876527984694016:12345-0@lo:101: 00010000:00010000:1.0:1789596663.339757:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596663.339777:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.339801:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.339813:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.339822:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670400, rc 0) 00000100:00100000:1.0:1789596663.339866:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694016:12345-0@lo:101: Request processed in 262us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.339873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789596663.340013:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694016:0@lo:101: 00010000:00010000:0.0:1789596663.340026:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596663.340037:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596663.340122:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694144:0@lo:501: 00000100:00100000:0.0:1789596663.340148:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.340173:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652540 going to sleep for 11 seconds 00000100:00100000:3.0:1789596663.340220:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694144 00000100:00100000:3.0:1789596663.340225:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694144 00000100:00100000:3.0:1789596663.340258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789596663.340266:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694144:12345-0@lo:501: 00000100:00100000:3.0:1789596663.340376:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694144:12345-0@lo:501: Request processed in 111us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.340383:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789596663.340478:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694144:0@lo:501: 00000100:00100000:1.0:1789596663.340504:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694272:0@lo:503: 00000100:00100000:1.0:1789596663.340540:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.340568:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596663.340613:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694272 00000100:00100000:0.0:1789596663.340616:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694272 00000100:00100000:0.0:1789596663.340812:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789596663.340818:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694272:12345-0@lo:503: 00000100:00100000:0.0:1789596663.340893:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694272:12345-0@lo:503: Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.340899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596663.341015:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694272:0@lo:503: 00000040:00080000:1.0:1789596663.341251:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596663.341308:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694400:0@lo:502: 00000100:00100000:1.0:1789596663.341343:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.341374:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596663.341422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694400 00000100:00100000:0.0:1789596663.341427:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694400 00000100:00100000:0.0:1789596663.341491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789596663.341499:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694400:12345-0@lo:502: 00000100:00100000:0.0:1789596663.341583:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694400:12345-0@lo:502: Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.341590:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789596663.341801:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694400:0@lo:502: 00000040:00080000:3.0:1789596663.342034:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789596663.342063:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789596663.342079:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789596663.342104:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789596663.342121:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789596663.342135:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789596663.342149:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789596663.342164:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789596663.342179:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789596663.342193:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789596663.342207:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789596663.342221:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789596663.342236:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789596663.342251:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789596663.342277:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789596663.342290:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789596663.342304:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789596663.342318:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789596663.342332:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789596663.342344:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789596663.342357:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789596663.342370:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789596663.342386:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789596663.342400:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789596663.342412:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789596663.342425:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789596663.342438:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789596663.342452:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789596663.342465:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789596663.342477:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789596663.342491:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789596663.342504:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789596663.342534:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789596663.342549:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789596663.342563:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789596663.342576:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789596663.342590:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789596663.342630:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694528:0@lo:502: 00000100:00100000:3.0:1789596663.342720:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596663.342947:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.343036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694528 00000100:00100000:1.0:1789596663.343043:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694528 00000100:00100000:1.0:1789596663.343076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789596663.343082:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694528:12345-0@lo:502: 00000100:00100000:1.0:1789596663.343205:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984694528:12345-0@lo:502: Request processed in 122us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.343217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789596663.343305:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984694528:0@lo:502: 00000040:00080000:3.0:1789596663.343351:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789596663.343360:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789596663.343884:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789596663.343901:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c7ebb18b380) 00000020:00000080:3.0:1789596663.343930:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789596663.344013:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebaf79000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596663.344018:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebaf79000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596663.344020:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebaf79000 3 00010000:00080000:3.0:1789596663.344047:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d82063000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596663.346231:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789596663.346444:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789596663.346485:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596663.346498:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7b5398e289bbe6e9 00000100:00080000:3.0:1789596663.346509:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596663.346520:0:8456:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7d82063000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596663.346554:0:8456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e859cc700 x1876527984694656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596663.346593:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984694656:0@lo:38: 00000100:00100000:3.0:1789596663.346660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789596663.346733:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789596663.347200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984695168:0@lo:400: 00000100:00100000:1.0:1789596663.347235:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.347270:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596663.347277:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984695040:0@lo:400: 00000100:00100000:1.0:1789596663.347300:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.347337:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694656 00000100:00100000:1.0:1789596663.347344:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694656 00000100:00100000:1.0:1789596663.347373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695040 00000100:00100000:1.0:1789596663.347376:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695040 00000100:00100000:1.0:1789596663.347402:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789596663.347410:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984695040:12345-0@lo:400: 00000100:00100000:1.0:1789596663.347458:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984695040:12345-0@lo:400: Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.347465:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789596663.347481:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596663.347485:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984694656:12345-0@lo:38: 00010000:00080000:1.0:1789596663.347504:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789596663.347528:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7b5398e289bbe6f0 00000004:00100000:1.0:1789596663.347542:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789596663.347569:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9c7eb651f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596663.347605:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876527984694656:12345-0@lo:38: Request processed in 118us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.347611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789596663.347707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7e859cc700 x1876527984694656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596663.347733:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789596663.347742:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789596663.347750:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789596663.347755:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789596663.347758:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789596663.347763:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984694656:0@lo:38: 00010000:00080000:1.0:1789596663.347805:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7e859cfb80 x1876527984695040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596663.347813:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984695040:0@lo:400: 00000100:00100000:1.0:1789596663.348308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984694784:0@lo:400: 00000100:00100000:1.0:1789596663.348345:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.348368:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596663.348374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984694912:0@lo:400: 00000100:00100000:1.0:1789596663.348396:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.348420:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694784 00000100:00100000:1.0:1789596663.348424:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694784 00000100:00100000:1.0:1789596663.348464:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596663.348471:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984694784:12345-0@lo:400: 00000100:00100000:1.0:1789596663.348508:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984694784:12345-0@lo:400: Request processed in 37us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.348514:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789596663.348539:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7e859cf800 x1876527984694784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596663.348548:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984694784:0@lo:400: 00000100:00100000:0.0:1789596663.350407:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695168 00000100:00100000:0.0:1789596663.350419:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695168 00000100:00100000:0.0:1789596663.350451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984694912 00000100:00100000:0.0:1789596663.350455:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984694912 00000100:00100000:0.0:1789596663.350473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596663.350483:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984695168:12345-0@lo:400: 00000100:00100000:0.0:1789596663.350566:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984695168:12345-0@lo:400: Request processed in 85us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.350573:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596663.350590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596663.350597:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984694912:12345-0@lo:400: 00000100:00100000:0.0:1789596663.350649:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984694912:12345-0@lo:400: Request processed in 53us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.350655:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596663.350713:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984694912:0@lo:400: 00000020:01000004:3.0:1789596663.350947:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789596663.350964:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c7ebb188000) 00000020:00000080:3.0:1789596663.350986:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789596663.351076:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebaf79000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596663.351080:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebaf79000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596663.351082:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebaf79000 3 00010000:00080000:3.0:1789596663.351120:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb6a6b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.116@tcp at head 00000100:00100000:1.0:1789596663.351754:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984695168:0@lo:400: 00010000:00010000:3.0:1789596663.353171:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789596663.353387:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789596663.353422:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596663.353432:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7b5398e289bbe6fe 00000100:00080000:3.0:1789596663.353442:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596663.353453:0:8456:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c7eb6a6b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596663.353493:0:8456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e859cdc00 x1876527984695296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596663.353555:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984695296:0@lo:38: 00000100:00100000:0.0:1789596663.353616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.353727:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695296 00000100:00100000:1.0:1789596663.353736:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695296 00000100:00100000:1.0:1789596663.353769:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596663.353777:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984695296:12345-0@lo:38: 00010000:00080000:1.0:1789596663.353803:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789596663.353835:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7b5398e289bbe705 00000004:00100000:1.0:1789596663.353850:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789596663.353882:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9c7eb651a000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789596663.354061:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789596663.357061:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876527984695296:12345-0@lo:38: Request processed in 3273us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.357077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1789596663.358845:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789596663.358949:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789596663.358980:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596663.358997:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596663.359010:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596663.359060:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596663.359062:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596663.359064:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596663.359065:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596663.359066:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596663.359068:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596663.359069:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596663.359071:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789596663.359072:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789596663.359074:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596663.359075:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596663.359079:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789596663.359081:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596663.359083:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596663.359084:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596663.359085:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596663.359086:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596663.359087:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596663.359088:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596663.359089:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789596663.359090:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789596663.359091:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596663.359101:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596663.359133:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789596663.359153:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984695424:0@lo:253: 00000100:00100000:3.0:1789596663.359222:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596663.359265:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596663.359366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695424 00000100:00100000:1.0:1789596663.359375:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695424 00000100:00100000:1.0:1789596663.359427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789596663.359437:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984695424:12345-0@lo:253: 20000000:01000000:1.0:1789596663.359474:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789596663.359487:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789596663.361175:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7e859cdc00 x1876527984695296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596663.361189:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596663.361199:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789596663.361208:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789596663.361213:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789596663.361973:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596663.361983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984695296:0@lo:38: 20000000:01000000:3.0:1789596663.371246:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789596663.371295:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789596663.371732:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:8428:x1876527984695424:12345-0@lo:253: Request processed in 12291us (12504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596663.371745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789596663.371871:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:8428:1876527984695424:0@lo:253: 10000000:01000000:0.0:1789596663.371886:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789596663.371888:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789596663.371890:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789596663.371891:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596663.371893:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596663.371894:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596663.371895:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596663.371897:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596663.371898:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596663.371899:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596663.371901:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596663.371903:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789596663.371919:0:8428:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789596663.373166:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789596663.373174:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789596663.375288:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.375316:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.375325:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.375332:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.375394:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.375410:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 15 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.375425:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984695552:0@lo:104: 00000100:00100000:1.0:1789596663.375497:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596663.375564:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.375572:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 15 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.375580:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984695680:0@lo:104: 00000100:00100000:1.0:1789596663.375600:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596663.375731:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789596663.375761:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596663.375783:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695552 00000100:00100000:2.0:1789596663.375791:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695552 00000100:00100000:2.0:1789596663.375826:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695680 00000100:00100000:2.0:1789596663.375828:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695680 00000100:00100000:2.0:1789596663.375839:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596663.375847:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebae25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6535:x1876527984695552:12345-0@lo:104: 00010000:00010000:2.0:1789596663.375859:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.375911:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596663.375917:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebae25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6535:x1876527984695552:12345-0@lo:104: Request processed in 71us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.375924:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596663.375959:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596663.375964:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984695680:12345-0@lo:104: 00010000:00010000:2.0:1789596663.375971:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.376007:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596663.376011:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984695680:12345-0@lo:104: Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.376016:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596663.376511:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984695552:0@lo:104: 00000100:00100000:1.0:1789596663.376520:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984695680:0@lo:104: 00010000:00010000:1.0:1789596663.376538:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376748:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789596663.376754:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376761:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596663.376765:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376785:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596663.376792:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596663.376797:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596663.376831:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376837:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596663.376859:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376866:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81510200/0x7b5398e289bbe617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376879:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596663.376882:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376887:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596663.376890:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376896:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596663.376903:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596663.376914:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596663.376929:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376934:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596663.376940:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376946:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe5fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe602 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.376961:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596663.376963:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596663.376965:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596663.376978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984695936:0@lo:103: 00000100:00100000:1.0:1789596663.377014:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.377047:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596663.377053:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984695808:0@lo:103: 00000100:00100000:1.0:1789596663.377072:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596663.377112:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695936 00000100:00100000:1.0:1789596663.377118:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695936 00010000:00010000:1.0:1789596663.377139:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 16 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.377159:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984695808 00000100:00100000:1.0:1789596663.377162:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984695808 00010000:00010000:1.0:1789596663.377173:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 17 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596663.377204:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596663.377211:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+17:3647:x1876527984695936:12345-0@lo:103: 00010000:00010000:1.0:1789596663.377222:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596663.377228:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 17 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377237:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 17 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377248:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030200/0x7b5398e289bbe602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe5fb expref: 17 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377260:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596663.377289:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+16:3647:x1876527984695936:12345-0@lo:103: Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.377295:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596663.377310:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596663.377316:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+15:3647:x1876527984695808:12345-0@lo:103: 00010000:00010000:1.0:1789596663.377323:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596663.377327:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 15 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377335:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 15 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377344:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe61e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe617 expref: 15 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377366:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377374:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789596663.377386:0:7927:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008550985s 00010000:00010000:1.0:1789596663.377390:0:7927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377396:0:7927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377404:0:7927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377410:0:7927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377416:0:7927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596663.377420:0:7927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377427:0:7927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377441:0:7927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377449:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596663.377478:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+14:3647:x1876527984695808:12345-0@lo:103: Request processed in 163us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596663.377485:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596663.377520:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984695808:0@lo:103: 00000100:00100000:1.0:1789596663.377528:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984695936:0@lo:103: 00010000:00010000:1.0:1789596663.377549:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377557:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596663.377563:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe70c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596663.377753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789596663.379146:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789596663.379294:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789596663.379500:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789596663.379869:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789596663.380068:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789596663.380298:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789596663.383542:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789596663.391598:0:8428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789596663.391608:0:8428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789596663.391816:0:8428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789596663.391866:0:8428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789596663.391887:0:8428:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789596663.391918:0:8428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789596663.397943:0:8428:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596663.398213:0:8428:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789596663.741097:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984696064:0@lo:41: 00000100:00100000:2.0:1789596663.741177:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596663.741397:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696064 00000100:00100000:0.0:1789596663.741407:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696064 00000100:00100000:0.0:1789596663.741535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596663.741546:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984696064:12345-0@lo:41: 00000004:00000024:0.0:1789596663.741582:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789596663.741636:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984696064:12345-0@lo:41: Request processed in 91us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596663.741643:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596663.741668:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984696064:0@lo:41: 00010000:00010000:2.0:1789596664.255521:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596664.510111:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789596664.510120:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7eb9a66000 from 30 10000000:01000000:2.0:1789596664.510127:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596664.510174:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.510187:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.510199:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.510225:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696192:0@lo:101: 00000100:00100000:2.0:1789596664.510298:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.510356:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92affe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.511834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696192 00000100:00100000:3.0:1789596664.511861:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696192 00000100:00100000:3.0:1789596664.512019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789596664.512030:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:6517:x1876527984696192:12345-0@lo:101: 00010000:00010000:3.0:1789596664.512049:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596664.512066:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe713 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.512106:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.512116:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.512125:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789596664.512260:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984696192:12345-0@lo:101: Request processed in 231us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.512267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789596664.515162:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696192:0@lo:101: 00010000:00010000:2.0:1789596664.515197:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.515222:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.515323:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696320:0@lo:501: 00000100:00100000:2.0:1789596664.515389:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.515433:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92affe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.515455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696320 00000100:00100000:2.0:1789596664.515461:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696320 00000100:00100000:2.0:1789596664.515505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789596664.515515:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984696320:12345-0@lo:501: 00000100:00100000:2.0:1789596664.515700:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984696320:12345-0@lo:501: Request processed in 185us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.515707:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789596664.515748:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696320:0@lo:501: 00000100:00100000:2.0:1789596664.515777:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696448:0@lo:503: 00000100:00100000:2.0:1789596664.515816:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.515833:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.515844:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696448 00000100:00100000:2.0:1789596664.515863:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696448 00000100:00100000:2.0:1789596664.515886:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789596664.515892:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984696448:12345-0@lo:503: 00000100:00100000:2.0:1789596664.516729:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984696448:12345-0@lo:503: Request processed in 833us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.516739:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789596664.516798:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696448:0@lo:503: 00000100:00100000:2.0:1789596664.517169:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8501:1876527984696576:0@lo:502: 00000100:00100000:2.0:1789596664.517214:0:8501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.517239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696576 00000100:00100000:2.0:1789596664.517244:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696576 00000100:00100000:2.0:1789596664.517273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789596664.517282:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8501:x1876527984696576:12345-0@lo:502: 00000100:00100000:2.0:1789596664.517525:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:8501:x1876527984696576:12345-0@lo:502: Request processed in 244us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.517532:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789596664.517571:0:8501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92affe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.517583:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8501:1876527984696576:0@lo:502: 00000100:00100000:2.0:1789596664.517700:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8501:1876527984696704:0@lo:502: 00000100:00100000:2.0:1789596664.517735:0:8501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.517763:0:8501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b7fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.518191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696704 00000100:00100000:3.0:1789596664.518197:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696704 00000100:00100000:3.0:1789596664.518236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789596664.518243:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:8501:x1876527984696704:12345-0@lo:502: 00000100:00100000:3.0:1789596664.518345:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:8501:x1876527984696704:12345-0@lo:502: Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.518353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789596664.518493:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8501:1876527984696704:0@lo:502: 00000040:00080000:2.0:1789596664.518515:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789596664.518786:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789596664.518809:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596664.518820:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.518832:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596664.518842:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789596664.519123:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb9a66000 from 5 10000000:01000000:3.0:1789596664.519127:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789596664.519160:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.519170:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.519180:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596664.519207:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696832:0@lo:101: 00000100:00100000:3.0:1789596664.519242:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.519310:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.522226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696832 00000100:00100000:2.0:1789596664.522241:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696832 00000100:00100000:3.0:1789596664.522368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789596664.522380:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984696832:12345-0@lo:101: 00010000:00010000:3.0:1789596664.522400:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596664.522420:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe721 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.522451:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.522464:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.522473:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:3.0:1789596664.522554:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984696832:12345-0@lo:101: Request processed in 177us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.522561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789596664.522605:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696832:0@lo:101: 00010000:00010000:3.0:1789596664.522842:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.522868:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596664.523129:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696960:0@lo:256: 00000100:00100000:3.0:1789596664.523186:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.523228:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.523249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984696960 00000100:00100000:3.0:1789596664.523254:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984696960 00000100:00100000:3.0:1789596664.523275:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789596664.523281:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984696960:12345-0@lo:256: 20000000:01000000:3.0:1789596664.523298:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789596664.523328:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789596664.523331:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789596664.523405:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984696960:12345-0@lo:256: Request processed in 123us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.523412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789596664.523440:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984696960:0@lo:256: 10000000:01000000:3.0:1789596664.523485:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789596664.523492:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.523501:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596664.523510:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789596664.523514:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789596664.523517:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789596664.523536:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.523544:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.523562:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596664.523573:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984697088:0@lo:101: 00000100:00100000:3.0:1789596664.523596:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.523770:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596664.523840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697088 00000100:00100000:0.0:1789596664.523845:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697088 00000100:00100000:0.0:1789596664.523879:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789596664.523886:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984697088:12345-0@lo:101: 00010000:00010000:0.0:1789596664.523895:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596664.523908:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe72f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596664.523927:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596664.523936:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596664.523943:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c7000, rc 0) 00000100:00100000:0.0:1789596664.523984:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984697088:12345-0@lo:101: Request processed in 98us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.524029:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984697088:0@lo:101: 00010000:00010000:3.0:1789596664.524040:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.524048:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596664.524113:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984697216:0@lo:501: 00000100:00100000:3.0:1789596664.524138:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.524158:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.524170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697216 00000100:00100000:3.0:1789596664.524173:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697216 00000100:00100000:0.0:1789596664.528216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789596664.528291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789596664.528317:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984697216:12345-0@lo:501: 00000100:00100000:3.0:1789596664.528528:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984697216:12345-0@lo:501: Request processed in 227us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.528536:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789596664.529808:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984697216:0@lo:501: 00000100:00100000:2.0:1789596664.530053:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984697344:0@lo:503: 00000100:00100000:2.0:1789596664.530140:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.530183:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b7fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.530203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697344 00000100:00100000:2.0:1789596664.530209:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697344 00000100:00100000:2.0:1789596664.530248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596664.530258:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984697344:12345-0@lo:503: 00000100:00100000:2.0:1789596664.530463:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984697344:12345-0@lo:503: Request processed in 206us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.530471:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596664.530519:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984697344:0@lo:503: 00000100:00100000:2.0:1789596664.530832:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8503:1876527984697472:0@lo:502: 00000100:00100000:2.0:1789596664.530881:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.530900:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697472 00000100:00100000:2.0:1789596664.530904:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697472 00000100:00100000:2.0:1789596664.530939:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789596664.530944:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:8503:x1876527984697472:12345-0@lo:502: 00000100:00100000:2.0:1789596664.531021:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:8503:x1876527984697472:12345-0@lo:502: Request processed in 76us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.531028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789596664.531060:0:8503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b7ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.531072:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8503:1876527984697472:0@lo:502: 00000020:01000000:2.0:1789596664.531105:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596664.531112:0:8503:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789596664.531119:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596664.531121:0:8503:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789596664.531127:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789596664.531130:0:8503:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789596664.531153:0:8503:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789596664.531155:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596664.531169:0:8503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c7d820cb380) 00000020:00000080:2.0:1789596664.531191:0:8503:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789596664.531196:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789596664.531274:0:8503:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789596664.531284:0:8503:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789596664.531290:0:8503:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbe744 00010000:00080000:2.0:1789596664.531334:0:8503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb9a77800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789596664.531567:0:8503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789596664.552393:0:8503:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789596664.552417:0:8503:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789596664.552659:0:8503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596664.553074:0:8503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596664.553176:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789596664.553271:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789596664.555584:0:8505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596664.555596:0:8505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789596664.559148:0:8503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789596664.559165:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789596664.560125:0:8503:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789596664.560158:0:8503:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe74b 00000100:00080000:2.0:1789596664.560172:0:8503:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596664.560186:0:8503:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb9a77800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596664.560232:0:8503:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb98d6680 x1876527984697600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596664.560266:0:8503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789596664.560610:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984697600:0@lo:8: 00000100:00100000:0.0:1789596664.560725:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.562064:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697600 00000100:00100000:3.0:1789596664.562079:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697600 00000100:00100000:3.0:1789596664.562134:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596664.562142:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984697600:12345-0@lo:8: 00010000:00080000:3.0:1789596664.562169:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1789596664.562197:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe752 00002000:00100000:3.0:1789596664.562237:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c7d82060800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789596664.562241:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789596664.562244:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789596664.562310:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789596664.562522:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789596664.562545:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d82065000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596664.562615:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984697600:12345-0@lo:8: Request processed in 474us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.562623:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596664.562651:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984697728:0@lo:400: 00000100:00100000:3.0:1789596664.562711:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.562733:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984698240:0@lo:400: 00000100:00100000:3.0:1789596664.562749:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.562765:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596664.562770:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984698112:0@lo:400: 00000100:00100000:3.0:1789596664.562789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.562810:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984697856:0@lo:400: 00000100:00100000:3.0:1789596664.562828:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.562841:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984698368:0@lo:400: 00000100:00100000:3.0:1789596664.562883:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.562899:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596664.562909:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984697984:0@lo:400: 00000100:00100000:3.0:1789596664.562933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789596664.562979:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d6680 x1876527984697600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.562989:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789596664.562998:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789596664.563004:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789596664.563010:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789596664.563013:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9a77800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596664.567075:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984698496:0@lo:700: 00000100:00100000:0.0:1789596664.567162:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.567225:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698496 00000100:00100000:0.0:1789596664.567234:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698496 00000100:00100000:0.0:1789596664.567298:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596664.567320:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8506:x1876527984698496:12345-0@lo:700: 00000100:00100000:0.0:1789596664.567359:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1876527984698624:0@lo:700: 00000100:00100000:0.0:1789596664.567391:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.567428:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92a73e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596664.567446:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88073780 going to sleep for 11 seconds 00000100:00080000:1.0:1789596664.567579:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596664.568386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697728 00000100:00100000:0.0:1789596664.568394:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697728 00000100:00100000:0.0:1789596664.568426:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698240 00000100:00100000:0.0:1789596664.568430:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698240 00000100:00100000:0.0:1789596664.568463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698368 00000100:00100000:0.0:1789596664.568467:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698368 00000100:00100000:0.0:1789596664.568481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697984 00000100:00100000:0.0:1789596664.568485:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697984 00000100:00100000:0.0:1789596664.568502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596664.568509:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984697728:12345-0@lo:400: 00000100:00100000:0.0:1789596664.568577:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984697728:12345-0@lo:400: Request processed in 68us (5864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.568584:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596664.568602:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596664.568608:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984698240:12345-0@lo:400: 00000100:00100000:0.0:1789596664.568636:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984698240:12345-0@lo:400: Request processed in 29us (5886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.568642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596664.568653:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596664.568660:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984698368:12345-0@lo:400: 00000100:00100000:0.0:1789596664.568715:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984698368:12345-0@lo:400: Request processed in 57us (5832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.568722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596664.568732:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596664.568738:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984697984:12345-0@lo:400: 00000100:00100000:0.0:1789596664.568766:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984697984:12345-0@lo:400: Request processed in 28us (5832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.568779:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596664.568799:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698112 00000100:00100000:0.0:1789596664.568803:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698112 00000100:00100000:0.0:1789596664.568818:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984697856 00000100:00100000:0.0:1789596664.568821:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984697856 00000100:00100000:0.0:1789596664.568832:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596664.568838:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984698112:12345-0@lo:400: 00000020:01000000:2.0:1789596664.569079:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596664.569104:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596664.569106:0:8503:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789596664.569110:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596664.569114:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596664.569116:0:8503:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596664.569118:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596664.569121:0:8503:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789596664.569152:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8503:1876527984698752:0@lo:502: 00000100:00100000:2.0:1789596664.569210:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.569237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698752 00000100:00100000:2.0:1789596664.569241:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698752 00000100:00100000:2.0:1789596664.569273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596664.569279:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:8503:x1876527984698752:12345-0@lo:502: 00000100:00100000:2.0:1789596664.569451:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:8503:x1876527984698752:12345-0@lo:502: Request processed in 172us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.569467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596664.569513:0:8503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.569535:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8503:1876527984698752:0@lo:502: 00000020:01000000:2.0:1789596664.569562:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596664.569566:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596664.569567:0:8503:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789596664.569571:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789596664.569625:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789596664.569647:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789596664.569657:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.569668:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596664.569697:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789596664.569700:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e867d5800 from 30 10000000:01000000:2.0:1789596664.569704:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596664.569730:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.569739:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.569749:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.569762:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984698880:0@lo:101: 00000100:00100000:2.0:1789596664.569788:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.569811:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596664.570040:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984698112:12345-0@lo:400: Request processed in 1200us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.570047:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596664.570065:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596664.570074:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984697856:12345-0@lo:400: 00000100:00100000:0.0:1789596664.570128:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984697856:12345-0@lo:400: Request processed in 56us (7299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.570134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789596664.570239:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596664.570245:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789596664.571418:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789596664.571434:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984697600:0@lo:8: 00000100:00100000:3.0:1789596664.571481:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698624 00000100:00100000:3.0:1789596664.571489:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698624 00000100:00100000:3.0:1789596664.571579:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596664.571588:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1876527984698624:12345-0@lo:700: 00010000:00080000:3.0:1789596664.572013:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e859cea00 x1876527984697984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.572027:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984697984:0@lo:400: 00000100:00100000:3.0:1789596664.572040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984697856:0@lo:400: 00010000:00080000:3.0:1789596664.572051:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e859cd880 x1876527984698368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.572059:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984698368:0@lo:400: 00000100:00100000:3.0:1789596664.572106:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984698112:0@lo:400: 00010000:00080000:3.0:1789596664.572120:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e859ce680 x1876527984697728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.572135:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984697728:0@lo:400: 00010000:00080000:3.0:1789596664.572149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e859ced80 x1876527984698240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.572157:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984698240:0@lo:400: 00000100:00100000:3.0:1789596664.572181:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984698880 00000100:00100000:3.0:1789596664.572186:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984698880 00000100:00100000:3.0:1789596664.572214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789596664.572221:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984698880:12345-0@lo:101: 00010000:00010000:3.0:1789596664.572231:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596664.572248:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe759 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.572272:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.572283:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.572292:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da000, rc 0) 00000100:00100000:3.0:1789596664.573016:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984698880:12345-0@lo:101: Request processed in 792us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.573024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789596664.573078:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984698880:0@lo:101: 00010000:00010000:3.0:1789596664.573111:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.573134:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596664.573208:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699008:0@lo:501: 00000100:00100000:3.0:1789596664.573241:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.573271:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.573288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699008 00000100:00100000:3.0:1789596664.573293:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699008 00000100:00100000:3.0:1789596664.573476:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596664.573485:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984699008:12345-0@lo:501: 00000100:00100000:3.0:1789596664.573617:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984699008:12345-0@lo:501: Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.573624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596664.573654:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699008:0@lo:501: 00000100:00100000:3.0:1789596664.573705:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699136:0@lo:503: 00000100:00100000:3.0:1789596664.573758:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.573773:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.573784:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699136 00000100:00100000:3.0:1789596664.573788:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699136 00000100:00100000:3.0:1789596664.573808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789596664.573814:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984699136:12345-0@lo:503: 00000004:00080000:0.0:1789596664.574428:0:8505:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789596664.574518:0:8505:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 239392838329ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789596664.574526:0:8505:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789596664.575358:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984699136:12345-0@lo:503: Request processed in 1537us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.575371:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:2.0:1789596664.577254:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789596664.579379:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699136:0@lo:503: 00000100:00100000:0.0:1789596664.580521:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8510:1876527984699264:0@lo:502: 00000100:00100000:0.0:1789596664.580633:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.580990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699264 00000100:00100000:3.0:1789596664.581008:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699264 00000100:00100000:0.0:1789596664.582020:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9938af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.582409:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789596664.582427:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:8510:x1876527984699264:12345-0@lo:502: 00000100:00100000:3.0:1789596664.582622:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:8510:x1876527984699264:12345-0@lo:502: Request processed in 201us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.582631:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789596664.582981:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8510:1876527984699264:0@lo:502: 00000100:00100000:0.0:1789596664.583057:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8510:1876527984699392:0@lo:502: 00000100:00100000:0.0:1789596664.583115:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.584234:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e958d70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596664.584316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699392 00000100:00100000:1.0:1789596664.584324:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699392 00000100:00100000:1.0:1789596664.584370:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789596664.584378:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:8510:x1876527984699392:12345-0@lo:502: 00000100:00100000:1.0:1789596664.584860:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:8510:x1876527984699392:12345-0@lo:502: Request processed in 466us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.584869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789596664.587478:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8510:1876527984699392:0@lo:502: 00000040:00080000:0.0:1789596664.587538:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789596664.588783:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789596664.588973:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596664.588986:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596664.588999:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596664.589012:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789596664.589014:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7e867d5800 from 5 10000000:01000000:0.0:1789596664.589017:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596664.589059:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596664.589069:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596664.589080:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596664.589117:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699520:0@lo:101: 00000100:00100000:0.0:1789596664.589191:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.589362:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9938af00 going to sleep for 11 seconds 40000000:02000000:3.0:1789596664.592545:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789596664.595454:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699520 00000100:00100000:2.0:1789596664.595473:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699520 00000100:00100000:2.0:1789596664.595562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789596664.595573:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984699520:12345-0@lo:101: 00010000:00010000:2.0:1789596664.595593:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596664.595618:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe767 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.595650:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.595662:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.595671:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510200, rc 0) 00000100:00100000:2.0:1789596664.595784:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984699520:12345-0@lo:101: Request processed in 213us (6592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.595791:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789596664.595861:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699520:0@lo:101: 00010000:00010000:2.0:1789596664.595882:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.595891:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.595975:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699648:0@lo:256: 00000100:00100000:2.0:1789596664.596018:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.597891:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1876527984698624:12345-0@lo:700: Request processed in 26297us (30492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.597905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789596664.597967:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027800 x1876527984698624/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.597983:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1876527984698624:0@lo:700: 40000000:02000000:3.0:1789596664.597996:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1789596664.598416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699648 00000100:00100000:1.0:1789596664.598424:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699648 00000100:00100000:1.0:1789596664.598464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789596664.598471:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984699648:12345-0@lo:256: 20000000:01000000:1.0:1789596664.598496:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789596664.598519:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789596664.598522:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789596664.598601:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984699648:12345-0@lo:256: Request processed in 130us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.598608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789596664.610730:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.610790:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699648:0@lo:256: 10000000:01000000:2.0:1789596664.611004:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596664.611016:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.611029:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596664.611041:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789596664.611044:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789596664.611047:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789596664.611099:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.611109:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.611118:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.611141:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699776:0@lo:101: 00000100:00100000:2.0:1789596664.611225:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.611275:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699776 00000100:00100000:2.0:1789596664.611283:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699776 00000100:00100000:2.0:1789596664.613570:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789596664.613587:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984699776:12345-0@lo:101: 00010000:00010000:2.0:1789596664.614159:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596664.614184:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe775 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.614225:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.614237:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.614247:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031a00, rc 0) 00000100:00100000:2.0:1789596664.615424:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984699776:12345-0@lo:101: Request processed in 1835us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.615436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789596664.615509:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.615536:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699776:0@lo:101: 00010000:00010000:2.0:1789596664.615557:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.615569:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.616193:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699904:0@lo:501: 00000100:00100000:2.0:1789596664.616255:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.616293:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984699904 00000001:00100000:3.0:1789596664.617573:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789596664.617782:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984699904 00000100:00100000:3.0:1789596664.618204:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8506:x1876527984698496:12345-0@lo:700: Request processed in 50880us (51037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.618224:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596664.618282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789596664.618293:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984699904:12345-0@lo:501: 00010000:00080000:1.0:1789596664.619050:0:8506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb026a00 x1876527984698496/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596664.619068:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984698496:0@lo:700: 00000100:00100000:3.0:1789596664.619265:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.619712:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984699904:12345-0@lo:501: Request processed in 1419us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.619734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789596664.621119:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984699904:0@lo:501: 00000100:00100000:3.0:1789596664.621202:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984700032:0@lo:503: 00000100:00100000:3.0:1789596664.621272:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.621384:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.621556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700032 00000100:00100000:2.0:1789596664.621563:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700032 00000100:00100000:2.0:1789596664.622898:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789596664.622916:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984700032:12345-0@lo:503: 00000100:00100000:2.0:1789596664.623094:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984700032:12345-0@lo:503: Request processed in 174us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.623101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789596664.627773:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984700032:0@lo:503: 00000004:00080000:3.0:1789596664.638109:0:8506:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789596664.638151:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984700288:0@lo:7: 00000100:00100000:3.0:1789596664.638246:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.638294:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d03a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.638389:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984700160:0@lo:13: 00000100:00100000:3.0:1789596664.638417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.638597:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8516:1876527984700416:0@lo:502: 00000100:00100000:3.0:1789596664.638742:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.638761:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d03f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596664.638833:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700416 00000100:00100000:1.0:1789596664.638841:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700416 00000100:00100000:1.0:1789596664.639021:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789596664.639032:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:8516:x1876527984700416:12345-0@lo:502: 00000100:00100000:1.0:1789596664.639179:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:8516:x1876527984700416:12345-0@lo:502: Request processed in 148us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.639187:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789596664.639243:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8516:1876527984700416:0@lo:502: 00000020:01000000:1.0:1789596664.639270:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789596664.639278:0:8516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789596664.639286:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596664.639288:0:8516:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789596664.639296:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789596664.639384:0:8516:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789596664.639407:0:8516:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789596664.639410:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596664.639437:0:8516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c7ebf990000) 00000020:00000080:1.0:1789596664.639461:0:8516:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789596664.639467:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789596664.639563:0:8516:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789596664.639569:0:8516:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789596664.639576:0:8516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe78a 00010000:00080000:1.0:1789596664.640039:0:8516:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e85984800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789596664.640291:0:8516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1789596664.640751:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700288 00000100:00100000:0.0:1789596664.640761:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700288 00000100:00100000:0.0:1789596664.640809:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596664.640819:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8506:x1876527984700288:12345-0@lo:7: 00000100:00100000:3.0:1789596664.641747:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700160 00000100:00100000:3.0:1789596664.641755:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700160 00000100:00100000:3.0:1789596664.641793:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596664.641803:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984700160:12345-0@lo:13: 00002000:00000024:3.0:1789596664.641819:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1789596664.642034:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984700160:12345-0@lo:13: Request processed in 234us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.642041:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789596664.642100:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e859cdc00 x1876527984700160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.642122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984700160:0@lo:13: 00002000:00080000:1.0:1789596664.651515:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789596664.651525:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789596664.651778:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8506:x1876527984700288:12345-0@lo:7: Request processed in 10954us (13525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.651793:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789596664.651928:0:8506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e859cd880 x1876527984700288/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.651944:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984700288:0@lo:7: 00000004:00080000:0.0:1789596664.651960:0:8506:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789596664.652005:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984700544:0@lo:5: 00000100:00100000:0.0:1789596664.652041:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.652091:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83427a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596664.652265:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700544 00000100:00100000:1.0:1789596664.652273:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700544 00000100:00100000:1.0:1789596664.652328:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596664.652338:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8506:x1876527984700544:12345-0@lo:5: 00002000:00080000:1.0:1789596664.652366:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789596664.652411:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8506:x1876527984700544:12345-0@lo:5: Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.652417:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789596664.655451:0:8506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027480 x1876527984700544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.655471:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984700544:0@lo:5: 00000004:00080000:0.0:1789596664.655487:0:8506:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789596664.655538:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984700672:0@lo:5: 00000100:00100000:0.0:1789596664.655599:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.655648:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83427a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.655735:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700672 00000100:00100000:2.0:1789596664.655742:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700672 00000100:00100000:2.0:1789596664.655801:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596664.655811:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8506:x1876527984700672:12345-0@lo:5: 00002000:00080000:2.0:1789596664.655872:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789596664.657564:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8506:x1876527984700672:12345-0@lo:5: Request processed in 1750us (1959us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789596664.657574:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789596664.658442:0:8506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027480 x1876527984700672/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.658461:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8506:1876527984700672:0@lo:5: 00000004:00080000:0.0:1789596664.658477:0:8506:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789596664.658517:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8506:1876527984700800:0@lo:900: 00000100:00100000:0.0:1789596664.658559:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.658595:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83427a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.659440:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700800 00000100:00100000:2.0:1789596664.659449:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700800 00000100:00100000:2.0:1789596664.659505:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596664.659515:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8506:x1876527984700800:12345-0@lo:900: 00000100:00100000:2.0:1789596664.659587:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8506:x1876527984700800:12345-0@lo:900: Request processed in 73us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.659594:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789596664.659734:0:8506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027b80 x1876527984700800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.659746:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8506:1876527984700800:0@lo:900: 00000040:01000000:3.0:1789596664.665236:0:8516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789596664.665267:0:8516:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789596664.665517:0:8516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596664.665762:0:8516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596664.666375:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789596664.666497:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789596664.667586:0:8519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596664.667592:0:8519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000004:1.0:1789596664.668481:0:8518:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789596664.669047:0:8518:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:0.0:1789596664.677188:0:8516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596664.677206:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789596664.677255:0:8516:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789596664.677281:0:8516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe791 00000100:00080000:0.0:1789596664.677291:0:8516:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596664.677303:0:8516:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7e85984800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596664.677340:0:8516:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb027b80 x1876527984700928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596664.677371:0:8516:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789596664.677453:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596664.677458:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596664.677459:0:8516:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789596664.677463:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596664.677466:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596664.677468:0:8516:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789596664.677471:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789596664.677473:0:8516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789596664.677503:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8516:1876527984701056:0@lo:502: 00000100:00100000:0.0:1789596664.677584:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.677723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701056 00000100:00100000:2.0:1789596664.677732:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701056 00000100:00100000:2.0:1789596664.677779:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789596664.677787:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+20:8516:x1876527984701056:12345-0@lo:502: 00000100:00100000:0.0:1789596664.677989:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e853b7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.678117:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+20:8516:x1876527984701056:12345-0@lo:502: Request processed in 330us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.678125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789596664.678208:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:8516:1876527984701056:0@lo:502: 00000020:01000000:0.0:1789596664.678232:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596664.678236:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596664.678237:0:8516:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789596664.678240:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789596664.678343:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789596664.678367:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789596664.678377:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678389:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596664.678398:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789596664.678401:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7e88948000 from 1 10000000:01000000:2.0:1789596664.678404:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596664.678426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678433:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678442:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.678453:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984701184:0@lo:101: 00000100:00100000:2.0:1789596664.678481:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.678497:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.678509:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701184 00000100:00100000:2.0:1789596664.678513:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701184 00000100:00100000:2.0:1789596664.678535:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789596664.678542:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984701184:12345-0@lo:101: 00010000:00010000:2.0:1789596664.678558:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596664.678570:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe798 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678591:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678601:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678620:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80030600, rc 0) 00000100:00100000:2.0:1789596664.678647:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984701184:12345-0@lo:101: Request processed in 106us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.678653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789596664.678697:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984701184:0@lo:101: 00010000:00010000:2.0:1789596664.678708:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596664.678717:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596664.678759:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984701312:0@lo:501: 00000100:00100000:2.0:1789596664.678782:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.678795:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596664.678805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701312 00000100:00100000:2.0:1789596664.678808:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701312 00000100:00100000:2.0:1789596664.678829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789596664.678835:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984701312:12345-0@lo:501: 00000100:00100000:3.0:1789596664.678991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984700928:0@lo:8: 00000100:00100000:3.0:1789596664.679032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.679784:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984701312:12345-0@lo:501: Request processed in 948us (1000us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596664.679791:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789596664.679905:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984701312:0@lo:501: 10000000:01000000:3.0:1789596664.679935:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789596664.679942:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596664.679951:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596664.680570:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984700928 00000100:00100000:1.0:1789596664.680578:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984700928 00000100:00100000:1.0:1789596664.680762:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596664.680768:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984700928:12345-0@lo:8: 00010000:00080000:1.0:1789596664.680804:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:1.0:1789596664.680837:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe7a6 00002000:00100000:1.0:1789596664.680921:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c7e83d71800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789596664.680926:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789596664.680928:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789596664.681007:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789596664.681034:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7e83d74800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596664.681111:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984700928:12345-0@lo:8: Request processed in 341us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.681118:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789596664.687595:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027b80 x1876527984700928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.687610:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596664.687629:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789596664.687655:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789596664.687661:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789596664.687665:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e85984800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789596664.687696:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789596664.687703:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984700928:0@lo:8: 00000004:00080000:3.0:1789596664.688577:0:8519:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789596664.690405:0:8519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 239508724178ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789596664.690414:0:8519:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789596664.691567:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984701440:0@lo:13: 00000100:00100000:3.0:1789596664.691667:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789596664.691766:0:8520:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789596664.691792:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701568:0@lo:7: 00000100:00100000:0.0:1789596664.691822:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596664.696969:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701440 00000100:00100000:3.0:1789596664.696986:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701440 00000100:00100000:3.0:1789596664.697066:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596664.697076:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984701440:12345-0@lo:13: 00002000:00000024:3.0:1789596664.697117:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1789596664.697208:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984701440:12345-0@lo:13: Request processed in 134us (5541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.697215:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789596664.697267:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027b80 x1876527984701440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596664.697289:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984701440:0@lo:13: 00000100:00100000:2.0:1789596664.697407:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701568 00000100:00100000:2.0:1789596664.697412:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701568 00000100:00100000:3.0:1789596664.697946:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596664.697954:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8520:x1876527984701568:12345-0@lo:7: 00000100:00080000:1.0:1789596664.703248:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596664.704446:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351900 going to sleep for 11 seconds 00002000:00080000:3.0:1789596664.709210:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789596664.709220:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789596664.709323:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8520:x1876527984701568:12345-0@lo:7: Request processed in 11365us (17495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596664.709333:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789596664.709761:0:8520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb025180 x1876527984701568/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596664.709779:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701568:0@lo:7: 00000004:00080000:1.0:1789596664.709796:0:8520:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789596664.709840:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701696:0@lo:5: 00000100:00100000:1.0:1789596664.709881:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596664.709921:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91745600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596664.710259:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701696 00000100:00100000:0.0:1789596664.710269:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701696 00000100:00100000:0.0:1789596664.710337:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596664.710346:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8520:x1876527984701696:12345-0@lo:5: 00002000:00080000:0.0:1789596664.710371:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789596664.710375:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:1.0:1789596664.716847:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00080000:0.0:1789596664.725556:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:0.0:1789596664.725576:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789596664.725581:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1789596664.746219:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8520:x1876527984701696:12345-0@lo:5: Request processed in 35864us (36327us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789596664.746233:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789596664.746337:0:8520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820abb80 x1876527984701696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.746349:0:8520:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789596664.746357:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701696:0@lo:5: 00000004:00080000:0.0:1789596664.746374:0:8520:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789596664.746431:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701824:0@lo:700: 00000100:00100000:0.0:1789596664.746466:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.746514:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596664.747794:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701824 00000100:00100000:1.0:1789596664.747808:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701824 00000100:00100000:1.0:1789596664.747863:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596664.747872:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8520:x1876527984701824:12345-0@lo:700: 00000100:00100000:2.0:1789596664.759823:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8520:x1876527984701824:12345-0@lo:700: Request processed in 11940us (13344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.759842:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789596664.759994:0:8520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb025500 x1876527984701824/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596664.760010:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701824:0@lo:700: 00000004:02000040:1.0:1789596664.780266:0:8520:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789596664.788581:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701952:0@lo:5: 00000100:00100000:1.0:1789596664.788723:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596664.788776:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91745480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596664.789050:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984701952 00000100:00100000:3.0:1789596664.789058:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984701952 00000100:00100000:3.0:1789596664.789129:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596664.789140:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8520:x1876527984701952:12345-0@lo:5: 00002000:00080000:3.0:1789596664.801344:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789596664.801364:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789596664.809116:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8520:x1876527984701952:12345-0@lo:5: Request processed in 19970us (20386us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789596664.809131:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789596664.809230:0:8520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820a8a80 x1876527984701952/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596664.809248:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8520:1876527984701952:0@lo:5: 00000004:00080000:1.0:1789596664.809264:0:8520:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1789596665.277995:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596666.304524:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596666.818378:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984702080:0@lo:41: 00000100:00100000:2.0:1789596666.818453:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596666.818606:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702080 00000100:00100000:0.0:1789596666.818628:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702080 00000100:00100000:0.0:1789596666.818704:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596666.818714:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984702080:12345-0@lo:41: 00000004:00000024:0.0:1789596666.818751:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789596666.818799:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984702080:12345-0@lo:41: Request processed in 87us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596666.818806:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789596666.818946:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984702080:0@lo:41: 00010000:00010000:1.0:1789596667.326441:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596668.351024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596668.864468:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596668.864494:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984702208:0@lo:41: 00000100:00100000:0.0:1789596668.864582:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596668.866102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702208 00000100:00100000:0.0:1789596668.866116:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702208 00000100:00100000:0.0:1789596668.866217:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596668.866228:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984702208:12345-0@lo:41: 00000004:00000024:0.0:1789596668.866263:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789596668.866343:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984702208:12345-0@lo:41: Request processed in 117us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596668.866350:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596668.876120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984702208:0@lo:41: 00010000:00010000:3.0:1789596669.377243:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596669.886404:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596669.886427:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984702464:0@lo:13: 00000100:00100000:0.0:1789596669.886500:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.887299:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984702336:0@lo:13: 00000100:00100000:3.0:1789596669.887342:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.887396:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702464 00000100:00100000:3.0:1789596669.887405:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702464 00000100:00100000:3.0:1789596669.887491:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702336 00000100:00100000:3.0:1789596669.887494:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702336 00000100:00100000:3.0:1789596669.887512:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596669.887521:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984702464:12345-0@lo:13: 00002000:00000024:3.0:1789596669.887550:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596669.887595:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984702464:12345-0@lo:13: Request processed in 75us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596669.887602:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596669.887620:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596669.887635:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984702336:12345-0@lo:13: 00002000:00000024:3.0:1789596669.887646:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596669.887673:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984702336:12345-0@lo:13: Request processed in 38us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596669.887703:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789596669.887722:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596669.887748:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027b80 x1876527984702336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.887757:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789596669.887973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984702336:0@lo:13: 00010000:00080000:3.0:1789596669.888007:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027800 x1876527984702464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.888021:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984702464:0@lo:13: 00000100:00100000:3.0:1789596669.890312:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984702976:0@lo:400: 00000100:00100000:3.0:1789596669.890393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.890445:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789596669.890453:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984702592:0@lo:400: 00000100:00100000:3.0:1789596669.890482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.890519:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984703104:0@lo:400: 00000100:00100000:3.0:1789596669.890544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.890571:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984702720:0@lo:400: 00000100:00100000:3.0:1789596669.890618:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.890638:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984703232:0@lo:400: 00000100:00100000:3.0:1789596669.890660:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.890713:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789596669.890721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984702848:0@lo:400: 00000100:00100000:3.0:1789596669.890742:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.890762:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984703360:0@lo:400: 00000100:00100000:3.0:1789596669.890989:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.891023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703104 00000100:00100000:3.0:1789596669.891031:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703104 00000100:00100000:3.0:1789596669.891087:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702848 00000100:00100000:3.0:1789596669.891091:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702848 00000100:00100000:3.0:1789596669.891106:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596669.891114:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984703104:12345-0@lo:400: 00000100:00100000:3.0:1789596669.891170:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984703104:12345-0@lo:400: Request processed in 56us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596669.891176:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596669.891193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596669.891200:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984702848:12345-0@lo:400: 00000100:00100000:3.0:1789596669.891231:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984702848:12345-0@lo:400: Request processed in 32us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596669.891237:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596669.891276:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984703104:0@lo:400: 00000100:00100000:3.0:1789596669.891302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984702848:0@lo:400: 00000100:00100000:0.0:1789596669.891979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702976 00000100:00100000:0.0:1789596669.891987:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702976 00000100:00100000:0.0:1789596669.892015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702720 00000100:00100000:0.0:1789596669.892018:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702720 00000100:00100000:0.0:1789596669.892030:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703232 00000100:00100000:0.0:1789596669.892042:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703232 00000100:00100000:0.0:1789596669.892088:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703360 00000100:00100000:0.0:1789596669.892092:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703360 00000100:00100000:0.0:1789596669.892108:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596669.892116:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984702976:12345-0@lo:400: 00000100:00100000:0.0:1789596669.892178:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984702976:12345-0@lo:400: Request processed in 63us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.892185:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596669.892198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596669.892204:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984702720:12345-0@lo:400: 00000100:00100000:0.0:1789596669.892234:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984702720:12345-0@lo:400: Request processed in 30us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.892240:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596669.892250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596669.892256:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984703232:12345-0@lo:400: 00000100:00100000:0.0:1789596669.892282:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984703232:12345-0@lo:400: Request processed in 26us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.892287:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596669.892297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596669.892303:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984703360:12345-0@lo:400: 00000100:00100000:0.0:1789596669.892326:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984703360:12345-0@lo:400: Request processed in 24us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.892331:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789596669.892414:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596669.892418:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789596669.892449:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb025500 x1876527984702976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.892462:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984702976:0@lo:400: 00010000:00080000:3.0:1789596669.892502:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8279aa00 x1876527984703360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.892511:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984703360:0@lo:400: 00010000:00080000:3.0:1789596669.892521:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027b80 x1876527984702720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.892530:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984702720:0@lo:400: 00010000:00080000:3.0:1789596669.892539:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb0c17800 x1876527984703232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.892547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984703232:0@lo:400: 00000100:00100000:0.0:1789596669.892735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984702592 00000100:00100000:0.0:1789596669.892740:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984702592 00000100:00100000:0.0:1789596669.892774:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789596669.893150:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:3644:x1876527984702592:12345-0@lo:400: 00000100:00100000:0.0:1789596669.893200:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:3644:x1876527984702592:12345-0@lo:400: Request processed in 420us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.893213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789596669.893526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984702592:0@lo:400: 00000001:00080000:2.0:1789596669.893997:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1789596670.398111:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789596670.443362:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789596671.421956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789596671.568468:0:8862:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789596671.568755:0:8862:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789596671.932871:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984703488:0@lo:41: 00000100:00100000:0.0:1789596671.932948:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596671.933070:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703488 00000100:00100000:1.0:1789596671.933080:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703488 00000100:00100000:1.0:1789596671.933131:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789596671.933140:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984703488:12345-0@lo:41: 00000004:00000024:1.0:1789596671.933189:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789596671.933608:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984703488:12345-0@lo:41: Request processed in 469us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596671.933617:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789596671.933739:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984703488:0@lo:41: 00010000:00010000:3.0:1789596672.448771:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596673.469184:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596673.980961:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596673.980990:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984703616:0@lo:41: 00000100:00100000:0.0:1789596673.981076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596673.981147:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703616 00000100:00100000:0.0:1789596673.981156:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703616 00000100:00100000:0.0:1789596673.981202:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596673.981211:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984703616:12345-0@lo:41: 00000004:00000024:0.0:1789596673.981246:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789596673.981291:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984703616:12345-0@lo:41: Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596673.981298:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596673.981347:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984703616:0@lo:41: 00010000:00010000:2.0:1789596674.493472:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789596674.910169:0:8964:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596674.910497:0:8964:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789596675.004953:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596675.004981:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984703744:0@lo:13: 00000100:00100000:3.0:1789596675.005066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596675.005137:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703744 00000100:00100000:3.0:1789596675.005145:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703744 00000100:00100000:3.0:1789596675.005205:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596675.005215:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984703744:12345-0@lo:13: 00002000:00000024:3.0:1789596675.005249:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596675.005299:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984703744:12345-0@lo:13: Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596675.005307:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789596675.005331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596675.005367:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d826c0a80 x1876527984703744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596675.005409:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984703744:0@lo:13: 00000100:00100000:0.0:1789596675.005596:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596675.005607:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984703872:0@lo:13: 00000100:00100000:0.0:1789596675.005638:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596675.005672:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984703872 00000100:00100000:0.0:1789596675.005696:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984703872 00000100:00100000:0.0:1789596675.005725:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596675.005731:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984703872:12345-0@lo:13: 00002000:00000024:0.0:1789596675.005743:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596675.005919:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984704128:0@lo:400: 00000100:00100000:1.0:1789596675.005954:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596675.005984:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984704640:0@lo:400: 00000100:00100000:1.0:1789596675.006016:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596675.006034:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789596675.006040:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984704000:0@lo:400: 00000100:00100000:1.0:1789596675.006066:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596675.006086:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984704512:0@lo:400: 00000100:00100000:1.0:1789596675.006110:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596675.006247:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984704384:0@lo:400: 00000100:00100000:3.0:1789596675.006271:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596675.006287:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789596675.006292:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984704256:0@lo:400: 00000100:00100000:3.0:1789596675.006311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596675.006328:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984704768:0@lo:400: 00000100:00100000:3.0:1789596675.006348:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596675.006366:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704512 00000100:00100000:3.0:1789596675.006371:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704512 00000100:00100000:3.0:1789596675.006394:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704256 00000100:00100000:3.0:1789596675.006396:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704256 00000100:00100000:3.0:1789596675.006411:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596675.006417:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984704512:12345-0@lo:400: 00000100:00100000:3.0:1789596675.006459:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984704512:12345-0@lo:400: Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596675.006465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596675.006479:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789596675.006484:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984704256:12345-0@lo:400: 00000100:00100000:1.0:1789596675.006589:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704128 00000100:00100000:1.0:1789596675.006594:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704128 00000100:00100000:1.0:1789596675.006616:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704640 00000100:00100000:1.0:1789596675.006620:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704640 00000100:00100000:1.0:1789596675.006633:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704384 00000100:00100000:1.0:1789596675.006635:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704384 00000100:00100000:1.0:1789596675.006645:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704768 00000100:00100000:1.0:1789596675.006647:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704768 00000100:00100000:1.0:1789596675.006661:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596675.006667:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984704128:12345-0@lo:400: 00000100:00100000:1.0:1789596675.006715:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984704128:12345-0@lo:400: Request processed in 49us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596675.006721:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596675.006732:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596675.006737:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984704640:12345-0@lo:400: 00000100:00100000:1.0:1789596675.006774:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984704640:12345-0@lo:400: Request processed in 36us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596675.006780:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596675.006791:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789596675.006797:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984704384:12345-0@lo:400: 00000100:00100000:3.0:1789596675.006865:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984704256:12345-0@lo:400: Request processed in 381us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596675.006871:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789596675.006903:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984704512:0@lo:400: 00010000:00080000:3.0:1789596675.006915:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820a8380 x1876527984704128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596675.006940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984704128:0@lo:400: 00010000:00080000:3.0:1789596675.006952:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820abb80 x1876527984704640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596675.006961:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984704640:0@lo:400: 00000100:00100000:2.0:1789596675.007132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704000 00000100:00100000:2.0:1789596675.007137:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704000 00000100:00100000:2.0:1789596675.007174:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789596675.007181:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:3645:x1876527984704000:12345-0@lo:400: 00000100:00100000:2.0:1789596675.007220:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:3645:x1876527984704000:12345-0@lo:400: Request processed in 41us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596675.007226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789596675.007263:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984704000:0@lo:400: 00000100:00100000:0.0:1789596675.008229:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984703872:12345-0@lo:13: Request processed in 2494us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596675.008239:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789596675.008282:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8279b800 x1876527984703872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596675.008291:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789596675.008312:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984703872:0@lo:13: 00000100:00100000:0.0:1789596675.008334:0:6521:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789596675.008342:0:6521:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789596675.008362:0:6520:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789596675.008370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596675.008378:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984704768:12345-0@lo:400: 00000100:00100000:1.0:1789596675.009153:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984704384:12345-0@lo:400: Request processed in 2352us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596675.009173:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789596675.009561:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984704256:0@lo:400: 00000100:00080000:1.0:1789596675.009902:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596675.009909:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596675.009912:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596675.010780:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984704768:12345-0@lo:400: Request processed in 2398us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596675.010792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789596675.015320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820ab800 x1876527984704768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596675.015340:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984704768:0@lo:400: 00010000:00080000:2.0:1789596675.015357:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820aa680 x1876527984704384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596675.015366:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984704384:0@lo:400: 00010000:00010000:1.0:1789596675.520305:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789596675.801581:0:9013:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789596675.801592:0:9013:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789596676.551010:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596677.054553:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596677.054584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984704896:0@lo:41: 00000100:00100000:0.0:1789596677.054664:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596677.054753:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984704896 00000100:00100000:0.0:1789596677.054761:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984704896 00000100:00100000:0.0:1789596677.054810:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789596677.054818:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984704896:12345-0@lo:41: 00000004:00000024:0.0:1789596677.054986:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789596677.055043:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984704896:12345-0@lo:41: Request processed in 225us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596677.055050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596677.055142:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984704896:0@lo:41: 00010000:00010000:2.0:1789596677.565903:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596678.591942:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596679.100878:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596679.100907:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984705024:0@lo:41: 00000100:00100000:2.0:1789596679.100998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596679.101127:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705024 00000100:00100000:0.0:1789596679.101136:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705024 00000100:00100000:0.0:1789596679.101190:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789596679.101199:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984705024:12345-0@lo:41: 00000004:00000024:0.0:1789596679.101232:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789596679.101280:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984705024:12345-0@lo:41: Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596679.101287:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789596679.101328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984705024:0@lo:41: 00010000:00010000:0.0:1789596679.621496:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596680.125532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984705152:0@lo:13: 00000100:00100000:1.0:1789596680.125616:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.125721:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705152 00000100:00100000:1.0:1789596680.125730:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705152 00000100:00100000:1.0:1789596680.125785:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596680.125795:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984705152:12345-0@lo:13: 00002000:00000024:1.0:1789596680.125824:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596680.125869:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984705152:12345-0@lo:13: Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596680.125876:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789596680.125897:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596680.125926:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d82799880 x1876527984705152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596680.125959:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984705152:0@lo:13: 00000100:00100000:1.0:1789596680.126511:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984705664:0@lo:400: 00000100:00100000:1.0:1789596680.126548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.126567:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984706176:0@lo:400: 00000100:00100000:1.0:1789596680.126589:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.126609:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789596680.126627:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984705536:0@lo:400: 00000100:00100000:1.0:1789596680.126651:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.126669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984706048:0@lo:400: 00000100:00100000:1.0:1789596680.126710:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.126734:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984705280:0@lo:400: 00000100:00100000:1.0:1789596680.126761:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.132842:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984705792:0@lo:400: 00000100:00100000:1.0:1789596680.132935:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.133013:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984706304:0@lo:13: 00000100:00100000:0.0:1789596680.133185:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705664 00000100:00100000:0.0:1789596680.133194:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705664 00000100:00100000:0.0:1789596680.133254:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706048 00000100:00100000:0.0:1789596680.133258:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706048 00000100:00100000:0.0:1789596680.133294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596680.133304:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984705664:12345-0@lo:400: 00000100:00100000:0.0:1789596680.133387:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984705664:12345-0@lo:400: Request processed in 84us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.133396:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596680.133414:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596680.133420:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984706048:12345-0@lo:400: 00000100:00100000:0.0:1789596680.133449:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984706048:12345-0@lo:400: Request processed in 30us (6738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.133455:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596680.133517:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705536 00000100:00100000:0.0:1789596680.133521:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705536 00000100:00100000:0.0:1789596680.133539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705792 00000100:00100000:0.0:1789596680.133542:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705792 00000100:00100000:0.0:1789596680.133572:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789596680.133578:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984705536:12345-0@lo:400: 00000100:00100000:0.0:1789596680.133613:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984705536:12345-0@lo:400: Request processed in 35us (6961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.133619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789596680.133630:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789596680.133635:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984705792:12345-0@lo:400: 00000100:00100000:0.0:1789596680.133660:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984705792:12345-0@lo:400: Request processed in 25us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.133666:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789596680.133710:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706176 00000100:00100000:0.0:1789596680.133715:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706176 00000100:00100000:0.0:1789596680.133742:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596680.133749:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984706176:12345-0@lo:400: 00000100:00100000:0.0:1789596680.133780:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984706176:12345-0@lo:400: Request processed in 31us (7190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.133786:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596680.133805:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984705408:0@lo:400: 00000100:00100000:0.0:1789596680.133832:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596680.133850:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984705920:0@lo:400: 00000100:00100000:0.0:1789596680.133869:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596680.133892:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705408 00000100:00100000:0.0:1789596680.133896:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705408 00000100:00100000:0.0:1789596680.133915:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705920 00000100:00100000:0.0:1789596680.133917:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705920 00000100:00100000:0.0:1789596680.133930:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596680.133935:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984705408:12345-0@lo:400: 00000100:00100000:0.0:1789596680.133985:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984705408:12345-0@lo:400: Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.133992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596680.134003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596680.134009:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984705920:12345-0@lo:400: 00000100:00100000:0.0:1789596680.134042:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984705920:12345-0@lo:400: Request processed in 23us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.134048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789596680.134081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8279bb80 x1876527984705408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596680.134097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984705408:0@lo:400: 00010000:00080000:0.0:1789596680.134106:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d82798a80 x1876527984705920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596680.134116:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984705920:0@lo:400: 00000100:00100000:0.0:1789596680.134160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984705280 00000100:00100000:0.0:1789596680.134164:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984705280 00000100:00100000:0.0:1789596680.134189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789596680.134196:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:3646:x1876527984705280:12345-0@lo:400: 00000100:00100000:0.0:1789596680.134226:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:3646:x1876527984705280:12345-0@lo:400: Request processed in 31us (7464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.134232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789596680.134263:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596680.134268:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596680.134270:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596680.134291:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984705536:0@lo:400: 00010000:00080000:0.0:1789596680.134312:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8279b480 x1876527984706048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596680.134321:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984706048:0@lo:400: 00010000:00080000:0.0:1789596680.134332:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d82799180 x1876527984705664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596680.134341:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984705664:0@lo:400: 00010000:00080000:0.0:1789596680.134349:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d82799f80 x1876527984706176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596680.134356:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984706176:0@lo:400: 00000100:00100000:1.0:1789596680.134699:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596680.134726:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984705280:0@lo:400: 00000100:00100000:1.0:1789596680.134737:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984705792:0@lo:400: 00000100:00100000:0.0:1789596680.135123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706304 00000100:00100000:0.0:1789596680.135129:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706304 00000100:00100000:0.0:1789596680.135172:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596680.135181:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984706304:12345-0@lo:13: 00002000:00000024:0.0:1789596680.135200:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596680.135241:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984706304:12345-0@lo:13: Request processed in 62us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.135248:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789596680.136013:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d826c0000 x1876527984706304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596680.136048:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984706304:0@lo:13: 00010000:00010000:2.0:1789596680.637191:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596681.667468:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596682.174009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984706432:0@lo:41: 00000100:00100000:2.0:1789596682.174092:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596682.174166:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706432 00000100:00100000:2.0:1789596682.174174:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706432 00000100:00100000:2.0:1789596682.174218:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596682.174227:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984706432:12345-0@lo:41: 00000004:00000024:2.0:1789596682.174259:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789596682.174307:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984706432:12345-0@lo:41: Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596682.174314:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596682.174360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984706432:0@lo:41: 00010000:00010000:0.0:1789596682.689408:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596683.709779:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596684.221344:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596684.221371:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984706560:0@lo:41: 00000100:00100000:0.0:1789596684.221449:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596684.221587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706560 00000100:00100000:2.0:1789596684.221612:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706560 00000100:00100000:2.0:1789596684.221673:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596684.221713:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984706560:12345-0@lo:41: 00000004:00000024:2.0:1789596684.221751:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789596684.221825:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984706560:12345-0@lo:41: Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596684.221833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789596684.221883:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984706560:0@lo:41: 00010000:00010000:2.0:1789596684.737549:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596685.246242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984706688:0@lo:13: 00000100:00100000:1.0:1789596685.246324:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596685.246730:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706688 00000100:00100000:2.0:1789596685.246738:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706688 00000100:00100000:2.0:1789596685.246802:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596685.246812:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984706688:12345-0@lo:13: 00002000:00000024:2.0:1789596685.246846:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596685.246908:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984706688:12345-0@lo:13: Request processed in 98us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596685.246914:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789596685.247198:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596685.247246:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d4e00 x1876527984706688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596685.247269:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984706688:0@lo:13: 00000100:00100000:0.0:1789596685.247800:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596685.247814:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984706816:0@lo:13: 00000100:00100000:0.0:1789596685.247866:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596685.248360:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706816 00000100:00100000:0.0:1789596685.248384:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706816 00000100:00100000:0.0:1789596685.248442:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596685.248450:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984706816:12345-0@lo:13: 00002000:00000024:0.0:1789596685.248469:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596685.248512:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984706816:12345-0@lo:13: Request processed in 63us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596685.248519:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789596685.248551:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8279b480 x1876527984706816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596685.248567:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984706816:0@lo:13: 00000100:00080000:1.0:1789596685.248829:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596685.252329:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984706944:0@lo:400: 00000100:00100000:0.0:1789596685.252408:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596685.252504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984706944 00000100:00100000:3.0:1789596685.252512:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984706944 00000100:00100000:3.0:1789596685.252563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789596685.252572:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:3647:x1876527984706944:12345-0@lo:400: 00000100:00100000:3.0:1789596685.257700:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:3647:x1876527984706944:12345-0@lo:400: Request processed in 5104us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596685.257719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789596685.257801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984707328:0@lo:400: 00000100:00100000:3.0:1789596685.257860:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596685.257939:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984707072:0@lo:400: 00000100:00100000:3.0:1789596685.257966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596685.257985:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596685.257992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984707200:0@lo:400: 00000100:00100000:3.0:1789596685.258016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596685.258064:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707328 00000100:00100000:3.0:1789596685.258072:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707328 00000100:00100000:3.0:1789596685.258112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707072 00000100:00100000:3.0:1789596685.258128:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707072 00000100:00100000:3.0:1789596685.258151:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789596685.258176:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984707328:12345-0@lo:400: 00000100:00100000:3.0:1789596685.258228:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984707328:12345-0@lo:400: Request processed in 54us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596685.258235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789596685.258247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596685.258254:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984707072:12345-0@lo:400: 00000100:00100000:3.0:1789596685.258284:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984707072:12345-0@lo:400: Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596685.258290:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596685.258310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707200 00000100:00100000:3.0:1789596685.258313:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707200 00000100:00100000:3.0:1789596685.258342:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789596685.258348:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984707200:12345-0@lo:400: 00000100:00100000:3.0:1789596685.258379:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984707200:12345-0@lo:400: Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596685.258385:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789596685.258660:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b7100 x1876527984707328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596685.258675:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984707328:0@lo:400: 00000100:00100000:3.0:1789596685.258729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984707200:0@lo:400: 00010000:00080000:3.0:1789596685.258739:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b6d80 x1876527984707072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596685.258746:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984707072:0@lo:400: 00000100:00100000:2.0:1789596685.259274:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984707712:0@lo:400: 00000100:00100000:2.0:1789596685.259315:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596685.259336:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596685.259341:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984707584:0@lo:400: 00000100:00100000:2.0:1789596685.259365:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596685.262147:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596685.262177:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984707456:0@lo:400: 00000100:00100000:3.0:1789596685.262280:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596685.262344:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707712 00000100:00100000:3.0:1789596685.262352:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707712 00000100:00100000:3.0:1789596685.262410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707584 00000100:00100000:3.0:1789596685.262414:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707584 00000100:00100000:3.0:1789596685.262451:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596685.262461:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984707712:12345-0@lo:400: 00000100:00100000:3.0:1789596685.262525:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984707712:12345-0@lo:400: Request processed in 66us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596685.262532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596685.262549:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596685.262555:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984707584:12345-0@lo:400: 00000100:00100000:3.0:1789596685.262586:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984707584:12345-0@lo:400: Request processed in 32us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596685.262591:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789596685.262613:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596685.262617:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789596685.262645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b4700 x1876527984707584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596685.262659:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984707584:0@lo:400: 00010000:00080000:3.0:1789596685.262672:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b7b80 x1876527984707712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596685.262709:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984707712:0@lo:400: 00000100:00100000:2.0:1789596685.262868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707456 00000100:00100000:2.0:1789596685.262872:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707456 00000100:00100000:2.0:1789596685.262912:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789596685.262919:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984707456:12345-0@lo:400: 00000100:00100000:2.0:1789596685.262972:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984707456:12345-0@lo:400: Request processed in 53us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596685.262979:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789596685.263795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984707456:0@lo:400: 00000100:00100000:0.0:1789596685.266400:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984706944:0@lo:400: 00010000:00010000:0.0:1789596685.757574:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789596686.725008:0:9512:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789596686.725012:0:9512:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789596686.725014:0:9512:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789596686.725141:0:9512:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7ebb0f4000 00000020:01000004:2.0:1789596686.725157:0:9512:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789596686.725171:0:9512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789596686.725185:0:9512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7d820c8000) 00000020:00000080:2.0:1789596686.725204:0:9512:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789596686.763620:0:9512:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789596686.765016:0:9512:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:1.0:1789596686.781568:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:2.0:1789596686.785074:0:9512:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789596686.785302:0:9512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789596686.785317:0:9512:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789596686.785332:0:9512:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7b5398e289bbe7b4 00000020:01000004:2.0:1789596686.785340:0:9512:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789596686.785363:0:9512:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789596686.785367:0:9512:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789596686.785373:0:9512:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789596686.785597:0:9512:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789596686.785602:0:9512:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789596686.804783:0:9512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596686.804821:0:9512:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789596686.804825:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596686.804827:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596686.804828:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596686.804830:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596686.804831:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596686.804832:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596686.804834:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596686.804835:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596686.804837:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596686.804839:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596686.804840:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596686.804844:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789596686.804846:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596686.804847:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596686.804848:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596686.804853:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596686.804854:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596686.804855:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596686.804856:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596686.804857:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596686.804858:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596686.804859:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596686.804860:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596686.805367:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789596686.805405:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984707840:0@lo:253: 00000100:00100000:2.0:1789596686.805485:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.805540:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596686.805650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707840 00000100:00100000:0.0:1789596686.805658:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707840 00000100:00100000:0.0:1789596686.805735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789596686.805745:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:9512:x1876527984707840:12345-0@lo:253: 20000000:01000000:0.0:1789596686.805776:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789596686.805781:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789596686.805786:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789596686.805789:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789596686.806051:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596686.806174:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789596686.806188:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789596686.806206:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789596686.806219:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789596686.806234:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789596686.806249:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789596686.806335:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789596686.806349:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1789596686.806351:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789596686.806365:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789596686.806371:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789596686.806383:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789596686.806389:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789596686.806415:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789596686.806422:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789596686.806436:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789596686.806453:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789596686.806520:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789596686.806530:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1789596686.806532:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789596686.806546:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789596686.806551:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789596686.806564:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789596686.806569:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789596686.806594:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789596686.806602:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789596686.806614:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789596686.806631:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789596686.807026:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789596686.807038:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1789596686.807040:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789596686.807053:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789596686.807058:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789596686.807071:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789596686.807083:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789596686.807100:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789596686.807106:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789596686.807118:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789596686.807132:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789596686.807145:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789596686.807147:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789596686.807151:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789596686.807196:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789596686.807199:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596686.807451:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596686.807483:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596686.807515:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789596686.807743:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789596686.807767:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789596686.807779:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789596686.807789:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789596686.807791:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596686.807970:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596686.808043:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596686.808061:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1789596686.809470:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1789596686.809493:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1789596686.809515:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1789596686.809526:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789596686.809528:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789596686.811350:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789596686.811399:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789596686.811417:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789596686.811652:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789596686.811728:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789596686.811742:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1789596686.811751:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789596686.811754:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789596686.814034:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789596686.814288:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789596686.814325:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789596686.814342:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789596686.814351:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789596686.814353:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789596686.815033:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789596686.815067:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789596686.815079:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789596686.815275:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789596686.815295:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789596686.815309:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:0.0:1789596686.815324:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789596686.815343:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815381:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815390:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815509:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815516:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815521:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815527:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815533:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815541:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815581:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815608:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 21 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.815635:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984707968:0@lo:104: 00000100:00100000:0.0:1789596686.815854:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596686.815966:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.815976:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 21 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.815996:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708096:0@lo:104: 00000100:00100000:0.0:1789596686.816019:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596686.816327:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.816336:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 21 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.816345:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708224:0@lo:104: 00000100:00100000:0.0:1789596686.816367:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.818296:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984707968 00000100:00100000:2.0:1789596686.818308:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984707968 00000100:00100000:2.0:1789596686.818542:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708096 00000100:00100000:2.0:1789596686.818547:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708096 00000100:00100000:2.0:1789596686.818569:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789596686.818578:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6514:x1876527984707968:12345-0@lo:104: 00010000:00010000:2.0:1789596686.818603:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.818704:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596686.818710:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6514:x1876527984707968:12345-0@lo:104: Request processed in 133us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.818717:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789596686.818736:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596686.818742:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984708096:12345-0@lo:104: 00010000:00010000:2.0:1789596686.818751:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.818795:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596686.818800:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984708096:12345-0@lo:104: Request processed in 59us (2781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.818817:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789596686.818847:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596686.818852:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.818860:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596686.818865:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.818875:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596686.818893:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596686.818899:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596686.818945:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.818952:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596686.818977:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.818989:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.819001:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596686.819005:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.819021:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596686.819024:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.819030:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596686.819037:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596686.819042:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596686.819058:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.819064:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596686.819070:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.819076:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe77c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.819086:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596686.819088:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596686.819090:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596686.819110:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984708352:0@lo:103: 00000100:00100000:2.0:1789596686.819146:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.819176:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596686.819181:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984708480:0@lo:103: 00000100:00100000:2.0:1789596686.819227:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596686.819670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708352 00000100:00100000:1.0:1789596686.819676:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708352 00010000:00010000:1.0:1789596686.819734:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 22 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596686.819757:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708480 00000100:00100000:1.0:1789596686.819760:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708480 00010000:00010000:1.0:1789596686.819771:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 23 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596686.819788:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596686.819794:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984708352:12345-0@lo:103: 00010000:00010000:1.0:1789596686.819805:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596686.819810:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 23 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.819821:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 23 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.819840:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596686.819999:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984708352:12345-0@lo:103: Request processed in 205us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.820006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596686.820022:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789596686.820028:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3646:x1876527984708480:12345-0@lo:103: 00010000:00010000:1.0:1789596686.820044:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596686.820049:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 22 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.820060:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 22 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.820175:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596686.820261:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708224 00000100:00100000:2.0:1789596686.820266:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708224 00000100:00100000:2.0:1789596686.820289:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789596686.820296:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984708224:12345-0@lo:104: 00010000:00010000:2.0:1789596686.820304:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.820342:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596686.820347:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984708224:12345-0@lo:104: Request processed in 53us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.820353:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789596686.820589:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.820602:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.820614:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708608:0@lo:104: 00000100:00100000:0.0:1789596686.822298:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596686.823202:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.823234:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.823249:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708736:0@lo:104: 00000100:00100000:0.0:1789596686.823288:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.823598:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708608 00000100:00100000:2.0:1789596686.823606:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708608 00000100:00100000:2.0:1789596686.823654:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708736 00000100:00100000:2.0:1789596686.823657:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708736 00000100:00100000:2.0:1789596686.823694:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596686.823706:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6514:x1876527984708608:12345-0@lo:104: 00010000:00010000:2.0:1789596686.823719:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.823780:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596686.823787:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+4:6514:x1876527984708608:12345-0@lo:104: Request processed in 84us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.823795:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596686.823820:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596686.823829:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984708736:12345-0@lo:104: 00010000:00010000:2.0:1789596686.823838:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.823918:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596686.823925:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984708736:12345-0@lo:104: Request processed in 98us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.823933:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789596686.823962:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596686.823968:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.823977:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596686.823993:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824004:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596686.824013:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596686.824019:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596686.824056:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824062:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596686.824085:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824093:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824124:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596686.824128:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824135:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596686.824139:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824146:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596686.824153:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596686.824158:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596686.824173:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824179:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596686.824188:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824195:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db600/0x7b5398e289bbe72f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824206:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596686.824209:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824225:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596686.824228:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824236:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596686.824243:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596686.824249:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596686.824270:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824277:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596686.824293:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824299:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81510a00/0x7b5398e289bbe713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe71a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.824312:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596686.824315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596686.824319:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596686.824333:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984708864:0@lo:103: 00000100:00100000:2.0:1789596686.824372:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.824778:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596686.824789:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984708992:0@lo:103: 00000100:00100000:2.0:1789596686.824834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596686.826316:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596686.826327:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596686.826345:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984709120:0@lo:103: 00010000:00010000:1.0:1789596686.826630:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596686.826708:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3646:x1876527984708480:12345-0@lo:103: Request processed in 6677us (7477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.826719:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789596686.826746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708864 00000100:00100000:1.0:1789596686.826753:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708864 00010000:00010000:1.0:1789596686.826779:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 22 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596686.826795:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984708992 00000100:00100000:1.0:1789596686.826798:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984708992 00010000:00010000:1.0:1789596686.826807:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596686.826819:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596686.826825:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+23:3644:x1876527984708864:12345-0@lo:103: 00010000:00010000:1.0:1789596686.826836:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596686.826841:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.826851:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.826875:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596686.826926:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+23:3644:x1876527984708864:12345-0@lo:103: Request processed in 100us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.826933:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596686.826945:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789596686.826951:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e91848450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3644:x1876527984708992:12345-0@lo:103: 00010000:00010000:1.0:1789596686.826959:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596686.826964:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.826973:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.826981:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596686.827003:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e91848450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3644:x1876527984708992:12345-0@lo:103: Request processed in 53us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.827009:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789596686.827065:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596686.827093:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984708480:0@lo:103: 00000100:00100000:1.0:1789596686.827103:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984708352:0@lo:103: 00000100:00100000:2.0:1789596686.827518:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984708992:0@lo:103: 00000100:00100000:2.0:1789596686.827530:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984708864:0@lo:103: 00000100:00100000:0.0:1789596686.830224:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596686.830384:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.830537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709120 00000100:00100000:2.0:1789596686.830546:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709120 00010000:00010000:2.0:1789596686.830579:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.830622:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596686.830631:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3647:x1876527984709120:12345-0@lo:103: 00010000:00010000:2.0:1789596686.830644:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596686.830650:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.830704:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 22 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.830717:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984709248:0@lo:104: 00000100:00100000:0.0:1789596686.830762:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.830801:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789596686.830811:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709248 00000100:00100000:0.0:1789596686.830814:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709248 00000100:00100000:0.0:1789596686.830851:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596686.830859:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82318c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984709248:12345-0@lo:104: 00010000:00010000:0.0:1789596686.830871:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.830935:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596686.830943:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82318c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984709248:12345-0@lo:104: Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596686.830959:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789596686.831067:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596686.831075:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.831084:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596686.831089:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.831098:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596686.831106:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596686.831112:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596686.831143:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.831149:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596686.831184:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.831202:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe6d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6db expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.831214:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596686.831216:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596686.831218:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596686.831457:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596686.831472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984709376:0@lo:103: 00000100:00100000:1.0:1789596686.831520:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596686.835056:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.835085:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596686.835167:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3647:x1876527984709120:12345-0@lo:103: Request processed in 4537us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.835177:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596686.835207:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709376 00000100:00100000:2.0:1789596686.835214:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709376 00010000:00010000:2.0:1789596686.835237:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 22 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.836024:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984709120:0@lo:103: 00010000:00010000:0.0:1789596686.836075:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836089:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 22 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.836103:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984709504:0@lo:104: 00000100:00100000:0.0:1789596686.836148:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.836191:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709504 00000100:00100000:0.0:1789596686.836196:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709504 00000100:00100000:0.0:1789596686.836227:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789596686.836235:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984709504:12345-0@lo:104: 00010000:00010000:0.0:1789596686.836247:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836285:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596686.836290:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6514:x1876527984709504:12345-0@lo:104: Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596686.836296:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789596686.836314:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596686.836320:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836327:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1789596686.836332:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836356:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596686.836364:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596686.836370:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596686.836391:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836476:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596686.836498:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836506:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6800/0x7b5398e289bbe6aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6b1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.836524:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596686.836526:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596686.836527:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596686.836535:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596686.836547:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984709632:0@lo:103: 00000100:00100000:0.0:1789596686.836578:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.844267:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709632 00000100:00100000:3.0:1789596686.844286:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709632 00010000:00010000:3.0:1789596686.844339:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 23 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596686.844380:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789596686.844390:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984709376:12345-0@lo:103: 00010000:00010000:3.0:1789596686.844406:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596686.844412:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.844425:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.844448:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596686.844540:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984709376:12345-0@lo:103: Request processed in 152us (13019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.845446:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789596686.845485:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789596686.845497:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+22:3645:x1876527984709632:12345-0@lo:103: 00010000:00010000:3.0:1789596686.845510:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596686.845537:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 22 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845630:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 22 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845653:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845663:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845708:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845717:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845724:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845731:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845738:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596686.845744:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845753:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845763:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.845781:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596686.845844:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+22:3645:x1876527984709632:12345-0@lo:103: Request processed in 351us (9265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.845851:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596686.847442:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984709376:0@lo:103: 00000100:00100000:0.0:1789596686.851587:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984709632:0@lo:103: 00000100:00100000:0.0:1789596686.851644:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789596686.851658:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe79f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe798 expref: 21 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851676:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984707968:0@lo:104: 00010000:00010000:0.0:1789596686.851715:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe77c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe775 expref: 20 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851724:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708096:0@lo:104: 00010000:00010000:0.0:1789596686.851732:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da000/0x7b5398e289bbe760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe759 expref: 19 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851740:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708224:0@lo:104: 00010000:00010000:0.0:1789596686.851748:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7000/0x7b5398e289bbe736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe72f expref: 18 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851755:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708608:0@lo:104: 00010000:00010000:0.0:1789596686.851762:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbe71a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe713 expref: 17 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851769:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984708736:0@lo:104: 00010000:00010000:0.0:1789596686.851777:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe6db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe6d4 expref: 16 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851785:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984709248:0@lo:104: 00010000:00010000:0.0:1789596686.851793:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe6b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe6aa expref: 15 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.851801:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876527984709504:0@lo:104: 00010000:00010000:0.0:1789596686.851827:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.851836:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.851848:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.851854:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe7bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789596686.851867:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789596686.859121:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+14:9512:x1876527984707840:12345-0@lo:253: Request processed in 53370us (53628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.859149:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789596686.859593:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984707840:0@lo:253: 10000000:01000000:2.0:1789596686.859611:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789596686.859621:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596686.859623:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596686.859624:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596686.859625:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789596686.859626:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596686.859627:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596686.859629:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596686.859630:0:9512:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789596686.859632:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596686.859633:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596686.859655:0:9512:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7ebb0f4000 from lustre-OST0001 10000000:01000000:2.0:1789596686.859726:0:9512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789596686.859729:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789596686.859737:0:9512:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7e88948000 local copy 10000000:01000000:2.0:1789596686.859741:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596686.859776:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.859787:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.859797:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.859814:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984709760:0@lo:101: 00000100:00100000:2.0:1789596686.859854:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.859903:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596686.860049:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709760 00000100:00100000:1.0:1789596686.860056:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709760 00000100:00100000:1.0:1789596686.860144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789596686.860154:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:9512:x1876527984709760:12345-0@lo:101: 00010000:00010000:1.0:1789596686.860178:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596686.860192:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe7c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe7c2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.860218:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe7c2 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.860230:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7c2 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.860239:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671200, rc 0) 00000100:00100000:1.0:1789596686.860273:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984709760:12345-0@lo:101: Request processed in 122us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.860279:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789596686.860904:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984709760:0@lo:101: 00010000:00010000:2.0:1789596686.861223:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.861233:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.861361:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984709888:0@lo:501: 00000100:00100000:2.0:1789596686.861782:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.861817:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596686.862020:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984709888 00000100:00100000:0.0:1789596686.862028:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984709888 00000100:00100000:0.0:1789596686.862512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789596686.862523:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984709888:12345-0@lo:501: 00000100:00100000:0.0:1789596686.862623:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984709888:12345-0@lo:501: Request processed in 102us (842us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596686.862632:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789596686.862746:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984709888:0@lo:501: 10000000:01000000:2.0:1789596686.862763:0:9512:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789596686.862786:0:9512:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789596686.862793:0:9512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.862803:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.862812:0:9512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.862833:0:9512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789596686.862858:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7ebb0f4000 10000000:01000000:2.0:1789596686.862862:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789596686.862867:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789596686.862870:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596686.862874:0:9512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789596686.862887:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789596686.863022:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596686.863219:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.863230:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596686.863234:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.863243:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596686.863262:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596686.863268:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596686.863287:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.863293:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596686.863324:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.863331:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7b5398e289bbe7c9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.863345:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596686.863347:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596686.863348:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596686.863390:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596686.863412:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984710144:0@lo:103: 00000100:00100000:3.0:1789596686.863448:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596686.863555:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.863564:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596686.863574:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710144 00000100:00100000:1.0:1789596686.863581:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710144 00010000:00010000:2.0:1789596686.863591:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.863608:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710016:0@lo:101: 00000100:00100000:1.0:1789596686.863630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596686.863645:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+15:3644:x1876527984710144:12345-0@lo:103: 00000100:00100000:2.0:1789596686.863647:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596686.863659:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596686.863673:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbe7c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe7c2 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.863717:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596686.863758:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+14:3644:x1876527984710144:12345-0@lo:103: Request processed in 120us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.863765:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596686.864006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984710144:0@lo:103: 00000100:00100000:2.0:1789596686.864239:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.864253:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710016 00000100:00100000:3.0:1789596686.864259:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710016 00000100:00100000:3.0:1789596686.864293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789596686.864301:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+14:9512:x1876527984710016:12345-0@lo:101: 00010000:00010000:3.0:1789596686.864312:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596686.864325:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe7d0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.864344:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.864356:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.864364:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da200, rc 0) 00000100:00100000:3.0:1789596686.864411:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710016:12345-0@lo:101: Request processed in 103us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.864417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789596686.864534:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710016:0@lo:101: 00010000:00010000:0.0:1789596686.864547:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596686.864556:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596686.864649:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710272:0@lo:501: 00000100:00100000:0.0:1789596686.864717:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.864754:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596686.865028:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710272 00000100:00100000:2.0:1789596686.865033:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710272 00000100:00100000:2.0:1789596686.865190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789596686.865198:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710272:12345-0@lo:501: 00000100:00100000:2.0:1789596686.865317:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710272:12345-0@lo:501: Request processed in 119us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.865324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789596686.866263:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710272:0@lo:501: 00000100:00100000:0.0:1789596686.866319:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710400:0@lo:503: 00000100:00100000:0.0:1789596686.866372:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.866411:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596686.868584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710400 00000100:00100000:2.0:1789596686.868603:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710400 00000100:00100000:2.0:1789596686.868673:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789596686.868724:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710400:12345-0@lo:503: 00000100:00100000:2.0:1789596686.868926:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710400:12345-0@lo:503: Request processed in 205us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.868934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596686.869439:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710400:0@lo:503: 00000040:00080000:0.0:1789596686.869766:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789596686.869864:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710528:0@lo:502: 00000100:00100000:0.0:1789596686.869937:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.869968:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596686.870226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710528 00000100:00100000:2.0:1789596686.870233:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710528 00000100:00100000:2.0:1789596686.870272:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789596686.870281:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710528:12345-0@lo:502: 00000100:00100000:2.0:1789596686.870411:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710528:12345-0@lo:502: Request processed in 131us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596686.870427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596686.870572:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710528:0@lo:502: 00000040:00080000:0.0:1789596686.870800:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789596686.870828:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789596686.870842:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789596686.870854:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789596686.870866:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789596686.870892:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789596686.871188:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710656:0@lo:502: 00000100:00100000:0.0:1789596686.871235:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.871315:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596686.878571:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710656 00000100:00100000:2.0:1789596686.878589:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710656 00000100:00100000:2.0:1789596686.878665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789596686.879616:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710656:12345-0@lo:502: 00000100:00100000:3.0:1789596686.879889:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710656:12345-0@lo:502: Request processed in 1204us (8642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.879922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789596686.880244:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710656:0@lo:502: 00000040:00080000:0.0:1789596686.880330:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789596686.880344:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789596686.881184:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789596686.881194:0:9523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789596686.881201:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596686.881204:0:9523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789596686.881216:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596686.881234:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c7ebf9919c0) 00000020:00000080:1.0:1789596686.881262:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789596686.881269:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789596686.881353:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebb0f4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789596686.881362:0:9523:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789596686.881370:0:9523:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7b5398e289bbe7e5 00010000:00010000:1.0:1789596686.886324:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789596686.886650:0:9523:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789596686.893738:0:9523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789596686.894645:0:9523:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789596686.899635:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789596686.899829:0:9523:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789596686.915606:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789596686.917853:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789596686.917865:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596686.917873:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596686.917875:0:9523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789596686.917888:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596686.917893:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596686.917894:0:9523:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596686.917897:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596686.917899:0:9523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789596686.917929:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596686.917932:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596686.917934:0:9523:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789596686.917938:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789596686.918284:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789596686.918321:0:9512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789596686.918344:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.918356:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596686.918364:0:9512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebb0f4000 from 1 10000000:01000000:1.0:1789596686.918367:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596686.918415:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.918424:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.918450:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596686.918476:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710784:0@lo:101: 00000100:00100000:1.0:1789596686.918782:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.918890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710784 00000100:00100000:3.0:1789596686.918898:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710784 00000100:00100000:3.0:1789596686.918949:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789596686.918959:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+15:9512:x1876527984710784:12345-0@lo:101: 00010000:00010000:3.0:1789596686.918977:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596686.918990:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe7ec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.919015:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.919025:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.919034:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98daa00, rc 0) 00000100:00100000:3.0:1789596686.919070:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984710784:12345-0@lo:101: Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.919077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789596686.919142:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.919167:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710784:0@lo:101: 00010000:00010000:3.0:1789596686.919181:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596686.919190:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596686.919283:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710912:0@lo:501: 00000100:00100000:3.0:1789596686.919319:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.919343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984710912 00000100:00100000:3.0:1789596686.919347:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984710912 00000100:00100000:3.0:1789596686.919369:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789596686.919375:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984710912:12345-0@lo:501: 00000100:00100000:3.0:1789596686.919480:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984710912:12345-0@lo:501: Request processed in 104us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.919487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789596686.919511:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.919521:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984710912:0@lo:501: 00000100:00100000:3.0:1789596686.919544:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711040:0@lo:503: 00000100:00100000:3.0:1789596686.919583:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.919602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711040 00000100:00100000:3.0:1789596686.919605:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711040 00000100:00100000:3.0:1789596686.919624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789596686.919630:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711040:12345-0@lo:503: 00000100:00100000:3.0:1789596686.919737:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711040:12345-0@lo:503: Request processed in 106us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.919743:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789596686.919778:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.919789:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711040:0@lo:503: 00000040:00080000:3.0:1789596686.920070:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596686.920133:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711168:0@lo:502: 00000100:00100000:3.0:1789596686.920165:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.920188:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711168 00000100:00100000:3.0:1789596686.920192:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711168 00000100:00100000:3.0:1789596686.920220:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789596686.920226:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711168:12345-0@lo:502: 00000100:00100000:3.0:1789596686.920304:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711168:12345-0@lo:502: Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.920310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789596686.920338:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.920350:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711168:0@lo:502: 00000040:00080000:3.0:1789596686.920556:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789596686.920581:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789596686.920600:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711296:0@lo:502: 00000100:00100000:3.0:1789596686.920633:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.920653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711296 00000100:00100000:3.0:1789596686.920657:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711296 00000100:00100000:3.0:1789596686.920703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789596686.920710:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711296:12345-0@lo:502: 00000100:00100000:3.0:1789596686.920769:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711296:12345-0@lo:502: Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.920775:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789596686.920805:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.920817:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711296:0@lo:502: 00000040:00080000:3.0:1789596686.920851:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789596686.920859:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789596686.925534:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596686.925546:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596686.925548:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789596686.925556:0:9527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7ebb0f4000 00000020:00000080:2.0:1789596686.925559:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596686.925570:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596686.925573:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596686.925575:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789596686.925578:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789596686.925694:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789596686.925725:0:9512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596686.925740:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.925765:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596686.925819:0:9512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789596686.925822:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7ebb0f4000 10000000:01000000:2.0:1789596686.925825:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7ebb0f4000 10000000:01000000:2.0:1789596686.925829:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596686.925834:0:9512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7ebb0f4000 from 1 10000000:01000000:2.0:1789596686.925837:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596686.925875:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.925895:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.925907:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.925930:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711424:0@lo:101: 00000100:00100000:2.0:1789596686.926005:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.926030:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596686.926264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711424 00000100:00100000:1.0:1789596686.926272:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711424 00000100:00100000:1.0:1789596686.926323:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789596686.926332:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:9512:x1876527984711424:12345-0@lo:101: 00010000:00010000:1.0:1789596686.926347:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596686.926359:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe7fa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.926381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.926390:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596686.926399:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671e00, rc 0) 00000100:00100000:1.0:1789596686.926447:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711424:12345-0@lo:101: Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.926454:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789596686.926905:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711424:0@lo:101: 00010000:00010000:2.0:1789596686.926921:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596686.926930:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596686.927039:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711552:0@lo:501: 00000100:00100000:2.0:1789596686.927070:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.927101:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596686.927242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711552 00000100:00100000:1.0:1789596686.927247:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711552 00000100:00100000:1.0:1789596686.927274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789596686.927280:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711552:12345-0@lo:501: 00000100:00100000:1.0:1789596686.927388:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711552:12345-0@lo:501: Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.927396:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789596686.927587:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711552:0@lo:501: 00000100:00100000:2.0:1789596686.927616:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711680:0@lo:503: 00000100:00100000:3.0:1789596686.929363:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596686.929518:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596686.930575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711680 00000100:00100000:1.0:1789596686.930588:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711680 00000100:00100000:1.0:1789596686.930655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789596686.930666:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711680:12345-0@lo:503: 00000100:00100000:1.0:1789596686.930852:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711680:12345-0@lo:503: Request processed in 187us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.930860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789596686.931006:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711680:0@lo:503: 00000040:00080000:2.0:1789596686.931306:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596686.931397:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711808:0@lo:502: 00000100:00100000:2.0:1789596686.931576:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.931610:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.931820:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711808 00000100:00100000:3.0:1789596686.931825:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711808 00000100:00100000:3.0:1789596686.931856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789596686.931864:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711808:12345-0@lo:502: 00000100:00100000:3.0:1789596686.938619:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711808:12345-0@lo:502: Request processed in 6740us (7027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.938639:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789596686.938976:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711808:0@lo:502: 00000040:00080000:2.0:1789596686.939260:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789596686.939294:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789596686.939310:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789596686.939323:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789596686.939335:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789596686.939347:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789596686.939358:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789596686.939370:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789596686.939383:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789596686.939395:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789596686.939424:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789596686.939439:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789596686.939453:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789596686.939466:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789596686.939480:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789596686.939515:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789596686.939530:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789596686.939542:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789596686.939555:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789596686.939568:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789596686.939581:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789596686.939593:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789596686.939605:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789596686.939617:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789596686.939629:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789596686.939642:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789596686.939655:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789596686.939668:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789596686.939724:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789596686.939740:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789596686.939754:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789596686.939780:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789596686.939796:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789596686.939811:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789596686.939824:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789596686.939837:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789596686.939851:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789596686.939866:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789596686.939893:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789596686.939910:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789596686.939924:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789596686.939937:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789596686.939950:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789596686.939963:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789596686.939976:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789596686.939989:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789596686.940036:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711936:0@lo:502: 00000100:00100000:2.0:1789596686.940111:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.940148:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596686.940802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984711936 00000100:00100000:1.0:1789596686.940812:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984711936 00000100:00100000:1.0:1789596686.940873:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789596686.940894:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711936:12345-0@lo:502: 00000100:00100000:1.0:1789596686.941053:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984711936:12345-0@lo:502: Request processed in 161us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.941060:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789596686.941289:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984711936:0@lo:502: 00000040:00080000:2.0:1789596686.941359:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789596686.941372:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789596686.942660:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789596686.942710:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c7ebb1899c0) 00000020:00000080:3.0:1789596686.942737:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789596686.942817:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebb0f4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596686.942821:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebb0f4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596686.942824:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebb0f4000 3 00010000:00080000:3.0:1789596686.942935:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb6634000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596686.953639:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1789596686.955525:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789596686.955589:0:9528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596686.955602:0:9528:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7b5398e289bbe80f 00000100:00080000:3.0:1789596686.955616:0:9528:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596686.955629:0:9528:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7eb6634000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596686.956499:0:9528:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d826c3100 x1876527984712064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596686.956558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984712064:0@lo:38: 00000100:00100000:0.0:1789596686.956639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789596686.958523:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789596686.962319:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712064 00000100:00100000:1.0:1789596686.962334:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712064 00000100:00100000:1.0:1789596686.962359:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984712192:0@lo:400: 00000100:00100000:1.0:1789596686.962495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596686.962568:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984712704:0@lo:400: 00000100:00100000:1.0:1789596686.962588:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.962647:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984712320:0@lo:400: 00000100:00100000:0.0:1789596686.962688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.962718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984712832:0@lo:400: 00000100:00100000:0.0:1789596686.962743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984712448:0@lo:400: 00000100:00100000:0.0:1789596686.962764:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984712576:0@lo:400: 00000100:00100000:0.0:1789596686.962780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.962797:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984713088:0@lo:400: 00000100:00100000:0.0:1789596686.962814:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596686.962837:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712320 00000100:00100000:0.0:1789596686.962840:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712320 00000100:00100000:0.0:1789596686.962918:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712576 00000100:00100000:0.0:1789596686.962922:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712576 00000100:00100000:0.0:1789596686.962939:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789596686.962947:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984712320:12345-0@lo:400: 00000100:00100000:0.0:1789596686.962999:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984712320:12345-0@lo:400: Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596686.963006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789596686.963023:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596686.963028:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984712576:12345-0@lo:400: 00000100:00100000:0.0:1789596686.963063:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984712576:12345-0@lo:400: Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596686.963068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596686.963084:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713088 00000100:00100000:0.0:1789596686.963087:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713088 00000100:00100000:0.0:1789596686.963111:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596686.967718:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984713088:12345-0@lo:400: 00000100:00100000:0.0:1789596686.967839:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984713088:12345-0@lo:400: Request processed in 4719us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596686.967859:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596686.967960:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984712576:0@lo:400: 00010000:00080000:0.0:1789596686.967978:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820ab800 x1876527984713088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596686.967990:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984713088:0@lo:400: 00000100:00100000:3.0:1789596686.981991:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712192 00000100:00100000:3.0:1789596686.982006:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712192 00000100:00100000:3.0:1789596686.982186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712704 00000100:00100000:3.0:1789596686.982190:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712704 00000100:00100000:3.0:1789596686.982212:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596686.982220:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984712192:12345-0@lo:400: 00000100:00100000:3.0:1789596686.982314:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984712192:12345-0@lo:400: Request processed in 95us (19819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.982321:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596686.982345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596686.982351:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984712704:12345-0@lo:400: 00000100:00100000:3.0:1789596686.982378:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984712704:12345-0@lo:400: Request processed in 27us (19789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.982383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596686.982393:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596686.982397:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984712064:12345-0@lo:38: 00010000:00080000:3.0:1789596686.982950:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1789596686.982985:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7b5398e289bbe816 00000004:00100000:3.0:1789596686.983002:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789596686.983244:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596686.983310:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876527984712064:12345-0@lo:38: Request processed in 911us (26671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.983319:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596686.983475:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596686.983537:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984712320:0@lo:400: 00000100:00100000:1.0:1789596686.983563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596686.983600:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984712960:0@lo:400: 00000100:00100000:1.0:1789596686.983641:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596686.984060:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712832 00000100:00100000:1.0:1789596686.984067:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712832 00000100:00100000:1.0:1789596686.984098:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712448 00000100:00100000:1.0:1789596686.984101:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712448 00000100:00100000:1.0:1789596686.984114:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789596686.984293:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984712832:12345-0@lo:400: 00000100:00100000:1.0:1789596686.984351:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984712832:12345-0@lo:400: Request processed in 62us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.984357:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789596686.984371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789596686.984377:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984712448:12345-0@lo:400: 00010000:00080000:2.0:1789596686.984486:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820a8e00 x1876527984712832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596686.984498:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984712832:0@lo:400: 00000100:00100000:1.0:1789596686.985715:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984712448:12345-0@lo:400: Request processed in 1333us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.985725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789596686.985751:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984712960 00000100:00100000:1.0:1789596686.985756:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984712960 00010000:00080000:2.0:1789596686.985774:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d826c2d80 x1876527984712448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596686.985787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984712448:0@lo:400: 00000100:00100000:1.0:1789596686.985789:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596686.985796:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984712960:12345-0@lo:400: 00010000:00080000:2.0:1789596686.985857:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820aa680 x1876527984712960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596686.985857:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984712960:12345-0@lo:400: Request processed in 62us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596686.985863:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596686.985867:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984712960:0@lo:400: 00010000:00080000:1.0:1789596686.986273:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d820a9180 x1876527984712704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596686.986284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984712704:0@lo:400: 00010000:00080000:1.0:1789596686.986306:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d826c1880 x1876527984712192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596686.986326:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984712192:0@lo:400: 00000020:01000004:3.0:1789596686.986590:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789596686.986619:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c7d835119c0) 00000020:00000080:3.0:1789596686.986643:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1789596686.986741:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebb0f4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596686.986745:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebb0f4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596686.986748:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebb0f4000 3 00010000:00080000:3.0:1789596686.986776:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb6a6e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.116@tcp at head 00000100:00080000:1.0:1789596686.992775:0:9530:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c7d831b5880 x1876527984713216/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596686.992790:0:9530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f11540 going to sleep for 0 seconds 00010000:00080000:0.0:1789596686.993371:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d826c3100 x1876527984712064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596686.993382:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596686.993391:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789596686.993514:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789596686.993521:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789596686.993525:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789596686.993533:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b51cbcb5): req@ffff9c7d831b5880 x1876527984713216/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596686.993920:0:9530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596686.993972:0:9530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f11540 going to sleep for 11 seconds 00000100:00100000:3.0:1789596686.994305:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713216 00000100:00100000:3.0:1789596686.994314:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713216 00000100:00100000:3.0:1789596686.994385:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596686.994395:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1876527984713216:12345-0@lo:901: 00000100:00100000:3.0:1789596686.994515:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1876527984713216:12345-0@lo:901: Request processed in 121us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596686.994534:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789596686.994733:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789596686.994762:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d831b5880 x1876527984713216/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789596702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596686.994775:0:9530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1876527984713216:0@lo:901: 00000100:00100000:0.0:1789596686.995838:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984712064:0@lo:38: 00010000:00010000:2.0:1789596686.997924:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789596686.998618:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789596686.998696:0:9528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789596686.998711:0:9528:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7b5398e289bbe824 00000100:00080000:2.0:1789596686.998723:0:9528:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596686.998737:0:9528:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c7eb6a6e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596686.998778:0:9528:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb67b4000 x1876527984713344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596686.998812:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789596686.998917:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984713344:0@lo:38: 00000100:00100000:3.0:1789596686.998997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596686.999249:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713344 00000100:00100000:2.0:1789596686.999259:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713344 00000100:00100000:2.0:1789596686.999346:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596686.999353:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876527984713344:12345-0@lo:38: 00010000:00080000:2.0:1789596686.999380:0:8967:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000040:00080000:3.0:1789596686.999489:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789596686.999968:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789596687.000008:0:9512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596687.000026:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596687.001699:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596687.001782:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596687.001784:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789596687.001786:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596687.001787:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596687.001788:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596687.001790:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596687.001792:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596687.001794:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789596687.001795:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789596687.001797:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596687.001798:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596687.001802:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789596687.001805:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596687.001806:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789596687.001807:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596687.001809:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596687.001810:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596687.001811:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596687.001812:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596687.001813:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789596687.001814:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789596687.001816:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596687.001822:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596687.002239:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789596687.002263:0:9512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984713472:0@lo:253: 00000100:00100000:3.0:1789596687.002342:0:9512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596687.002380:0:9512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0840 going to sleep for 11 seconds 00000020:00000080:2.0:1789596687.005180:0:8967:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7b5398e289bbe82b 00000004:00100000:2.0:1789596687.005207:0:8967:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789596687.005260:0:8967:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596687.005377:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876527984713344:12345-0@lo:38: Request processed in 6021us (6377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596687.005389:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789596687.006756:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b4000 x1876527984713344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596687.006771:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596687.006781:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789596687.006790:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789596687.006795:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789596687.006798:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596687.006805:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984713344:0@lo:38: 00000100:00100000:1.0:1789596687.008720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713472 00000100:00100000:1.0:1789596687.008732:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713472 00000100:00100000:1.0:1789596687.008785:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789596687.008795:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984713472:12345-0@lo:253: 20000000:01000000:1.0:1789596687.008831:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789596687.008844:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789596687.025205:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789596687.025228:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789596687.025593:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:9512:x1876527984713472:12345-0@lo:253: Request processed in 16794us (23245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596687.025606:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596687.025732:0:9512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d576172c-8178-43f9-add9-c496dd76058d:9512:1876527984713472:0@lo:253: 10000000:01000000:0.0:1789596687.025758:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789596687.025762:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789596687.025763:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789596687.025764:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596687.025766:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596687.025767:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596687.025768:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596687.025770:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596687.025771:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596687.025772:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596687.025774:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596687.025775:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789596687.025790:0:9512:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789596687.025905:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789596687.025916:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789596687.025937:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.025953:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.025962:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.025969:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.026004:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.026018:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 16 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596687.026041:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984713600:0@lo:104: 00000100:00100000:2.0:1789596687.026088:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596687.026144:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.026153:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596687.026162:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984713728:0@lo:104: 00000100:00100000:2.0:1789596687.026183:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596687.026199:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596687.026217:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713600 00000100:00100000:2.0:1789596687.026224:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713600 00000100:00100000:2.0:1789596687.026257:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713728 00000100:00100000:2.0:1789596687.026260:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713728 00000100:00100000:1.0:1789596687.026269:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596687.026283:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6535:x1876527984713600:12345-0@lo:104: 00010000:00010000:1.0:1789596687.026295:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.026356:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596687.026362:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:6535:x1876527984713600:12345-0@lo:104: Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596687.028492:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984713600:0@lo:104: 00000100:00100000:1.0:1789596687.030008:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789596687.030269:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596687.030280:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.030292:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596687.030297:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.030308:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596687.030316:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596687.030322:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596687.030404:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.030411:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596687.030443:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.030450:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe76e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596687.030459:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984713856:0@lo:103: 00010000:00010000:2.0:1789596687.030464:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596687.030466:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596687.030467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596687.030530:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596687.030572:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713856 00000100:00100000:2.0:1789596687.030591:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713856 00010000:00010000:2.0:1789596687.030622:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 17 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596687.030812:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789596687.030823:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984713728:12345-0@lo:104: 00010000:00010000:1.0:1789596687.030834:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.030924:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596687.030930:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:6535:x1876527984713728:12345-0@lo:104: Request processed in 110us (4747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596687.030936:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789596687.030953:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596687.030957:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.030964:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596687.030967:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.030974:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596687.030982:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596687.030987:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789596687.031002:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596687.031009:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+17:3646:x1876527984713856:12345-0@lo:103: 00010000:00010000:1.0:1789596687.031014:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.031019:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596687.031020:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596687.031025:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 17 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.031030:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.031036:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db200/0x7b5398e289bbe721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.031037:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 17 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.031049:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596687.031051:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe76e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe767 expref: 17 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596687.031051:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596687.031053:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596687.031060:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789596687.031064:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596687.031067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984713984:0@lo:103: 00000100:00100000:1.0:1789596687.031088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596687.031093:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+16:3646:x1876527984713856:12345-0@lo:103: Request processed in 85us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596687.031167:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00080000:10000000:0.0:1789596687.037719:0:9512:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789596687.038608:0:9512:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789596687.038866:0:9512:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789596687.039740:0:9512:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789596687.040277:0:9512:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00000100:00100000:1.0:1789596687.040591:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984713856:0@lo:103: 00080000:10000000:0.0:1789596687.041158:0:9512:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1789596687.045556:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984713984 00000100:00100000:2.0:1789596687.045575:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984713984 00010000:00010000:2.0:1789596687.045629:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596687.045694:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596687.045704:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+16:3646:x1876527984713984:12345-0@lo:103: 00010000:00010000:2.0:1789596687.045719:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596687.045724:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045737:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 16 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045760:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045769:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596687.045789:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.019879579s 00010000:00010000:2.0:1789596687.045794:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045801:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045807:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045829:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045835:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789596687.045840:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045863:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045873:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.045895:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596687.046207:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+16:3646:x1876527984713984:12345-0@lo:103: Request processed in 504us (15116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596687.046215:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789596687.046275:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbe728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe721 expref: 15 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596687.046290:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876527984713728:0@lo:104: 00010000:00010000:2.0:1789596687.046311:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.046321:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.046327:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596687.046345:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe832 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596687.051321:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984713984:0@lo:103: 00000001:00000004:2.0:1789596687.054530:0:9512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789596687.083540:0:9512:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789596687.083550:0:9512:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789596687.083591:0:9512:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789596687.083643:0:9512:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789596687.083659:0:9512:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789596687.083968:0:9512:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789596687.085990:0:9512:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596687.088487:0:9512:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789596687.296078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984714112:0@lo:41: 00000100:00100000:2.0:1789596687.296160:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596687.296240:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714112 00000100:00100000:2.0:1789596687.296248:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714112 00000100:00100000:2.0:1789596687.297834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789596687.297847:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984714112:12345-0@lo:41: 00000004:00000024:2.0:1789596687.297893:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789596687.297960:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984714112:12345-0@lo:41: Request processed in 116us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596687.297967:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789596687.298019:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984714112:0@lo:41: 00010000:00010000:1.0:1789596687.806642:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789596688.319284:0:9584:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596688.319516:0:9584:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789596688.829800:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596689.342465:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596689.342489:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984714240:0@lo:41: 00000100:00100000:0.0:1789596689.342560:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596689.342623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714240 00000100:00100000:0.0:1789596689.342648:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714240 00000100:00100000:0.0:1789596689.342711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596689.342720:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984714240:12345-0@lo:41: 00000004:00000024:0.0:1789596689.342751:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789596689.342790:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984714240:12345-0@lo:41: Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596689.342797:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596689.342852:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984714240:0@lo:41: 00010000:00010000:1.0:1789596689.854162:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596690.364890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984714368:0@lo:13: 00000100:00100000:3.0:1789596690.364972:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596690.365093:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714368 00000100:00100000:0.0:1789596690.365103:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714368 00000100:00100000:0.0:1789596690.365173:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596690.365186:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984714368:12345-0@lo:13: 00002000:00000024:0.0:1789596690.365216:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596690.365270:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984714368:12345-0@lo:13: Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596690.365277:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789596690.365323:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b1500 x1876527984714368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596690.365344:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984714368:0@lo:13: 00000100:00080000:3.0:1789596690.365409:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596690.368157:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984714496:0@lo:13: 00000100:00100000:3.0:1789596690.368237:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596690.368348:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714496 00000100:00100000:0.0:1789596690.368360:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714496 00000100:00100000:0.0:1789596690.368448:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596690.368459:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984714496:12345-0@lo:13: 00002000:00000024:0.0:1789596690.368485:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596690.368537:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984714496:12345-0@lo:13: Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596690.368544:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789596690.368603:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b4000 x1876527984714496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596690.368623:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984714496:0@lo:13: 00000100:00080000:3.0:1789596690.368774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789596690.880130:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596691.904259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596692.413118:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596692.413155:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984714624:0@lo:41: 00000100:00100000:1.0:1789596692.413252:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596692.413426:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714624 00000100:00100000:0.0:1789596692.413448:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714624 00000100:00100000:0.0:1789596692.413512:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596692.413523:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984714624:12345-0@lo:41: 00000004:00000024:0.0:1789596692.413568:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789596692.413626:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984714624:12345-0@lo:41: Request processed in 105us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.413633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789596692.413909:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984714624:0@lo:41: 00000100:00100000:2.0:1789596692.414735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984714880:0@lo:400: 00000100:00100000:3.0:1789596692.414738:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984715136:0@lo:400: 00000100:00100000:2.0:1789596692.414810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596692.414866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596692.414879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984715392:0@lo:400: 00000100:00100000:2.0:1789596692.414920:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596692.414939:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984715648:0@lo:400: 00000100:00100000:2.0:1789596692.414961:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984715904:0@lo:400: 00000100:00100000:3.0:1789596692.414995:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596692.415008:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596692.415045:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789596692.415052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984715008:0@lo:400: 00000100:00100000:3.0:1789596692.415059:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789596692.415073:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984714752:0@lo:400: 00000100:00100000:2.0:1789596692.415105:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596692.415123:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596692.415142:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984715520:0@lo:400: 00000100:00100000:3.0:1789596692.415171:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984715264:0@lo:400: 00000100:00100000:2.0:1789596692.415196:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596692.415214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596692.415242:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984715776:0@lo:400: 00000100:00100000:2.0:1789596692.415253:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714880 00000100:00100000:2.0:1789596692.415262:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714880 00000100:00100000:3.0:1789596692.415276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596692.415322:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715136 00000100:00100000:3.0:1789596692.415325:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715648 00000100:00100000:2.0:1789596692.415329:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715136 00000100:00100000:3.0:1789596692.415338:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715648 00000100:00100000:2.0:1789596692.415353:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715392 00000100:00100000:2.0:1789596692.415358:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715392 00000100:00100000:2.0:1789596692.415393:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715904 00000100:00100000:2.0:1789596692.415398:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715904 00000100:00100000:2.0:1789596692.415425:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715264 00000100:00100000:3.0:1789596692.415426:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715520 00000100:00100000:2.0:1789596692.415430:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715264 00000100:00100000:3.0:1789596692.415446:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715520 00000100:00100000:3.0:1789596692.415477:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596692.415486:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984715648:12345-0@lo:400: 00000100:00100000:3.0:1789596692.415543:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984715648:12345-0@lo:400: Request processed in 57us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.415550:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596692.415568:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596692.415573:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984715520:12345-0@lo:400: 00000100:00100000:3.0:1789596692.415609:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984715520:12345-0@lo:400: Request processed in 35us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.415615:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596692.415651:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984714752 00000100:00100000:1.0:1789596692.415656:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715776 00000100:00100000:3.0:1789596692.415657:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984714752 00000100:00100000:1.0:1789596692.415671:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715776 00000100:00100000:3.0:1789596692.415731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789596692.415747:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:3644:x1876527984714752:12345-0@lo:400: 00000100:00100000:1.0:1789596692.415780:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789596692.415802:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984714880:12345-0@lo:400: 00000100:00100000:3.0:1789596692.415804:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:3644:x1876527984714752:12345-0@lo:400: Request processed in 48us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.415824:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1789596692.415879:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596692.415888:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596692.415893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596692.415896:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984714880:12345-0@lo:400: Request processed in 102us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596692.415905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789596692.415933:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596692.415938:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984714752:0@lo:400: 00000100:00100000:1.0:1789596692.415944:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984715136:12345-0@lo:400: 00010000:00080000:3.0:1789596692.415966:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b6d80 x1876527984715648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596692.415984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984715648:0@lo:400: 00000100:00100000:1.0:1789596692.415995:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984715136:12345-0@lo:400: Request processed in 48us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596692.416006:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596692.416031:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789596692.416039:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5c00 x1876527984715136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596692.416042:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984715392:12345-0@lo:400: 00000100:00100000:3.0:1789596692.416064:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984715136:0@lo:400: 00000100:00100000:1.0:1789596692.416091:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984715392:12345-0@lo:400: Request processed in 52us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596692.416099:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789596692.416124:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789596692.416128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984715008 00000100:00100000:1.0:1789596692.416135:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984715904:12345-0@lo:400: 00000100:00100000:3.0:1789596692.416138:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984715008 00000100:00100000:1.0:1789596692.416180:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984715904:12345-0@lo:400: Request processed in 48us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596692.416198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789596692.416200:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789596692.416214:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984715008:12345-0@lo:400: 00000100:00100000:1.0:1789596692.416221:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789596692.416232:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984715776:12345-0@lo:400: 00000100:00100000:3.0:1789596692.416281:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984715008:12345-0@lo:400: Request processed in 67us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.416289:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789596692.416301:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984715776:12345-0@lo:400: Request processed in 71us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596692.416309:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789596692.416350:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984715008:0@lo:400: 00010000:00080000:3.0:1789596692.416368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b4700 x1876527984715520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596692.416378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984715520:0@lo:400: 00010000:00080000:1.0:1789596692.416403:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5500 x1876527984715776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789596692.416404:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5f80 x1876527984714880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596692.416414:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984714880:0@lo:400: 00010000:00080000:3.0:1789596692.416438:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b7b80 x1876527984715392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596692.416446:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984715392:0@lo:400: 00010000:00080000:3.0:1789596692.416456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b7100 x1876527984715904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596692.416463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984715904:0@lo:400: 00000100:00100000:1.0:1789596692.416574:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984715776:0@lo:400: 00000100:00100000:2.0:1789596692.417642:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596692.417653:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984715264:12345-0@lo:400: 00000100:00100000:2.0:1789596692.417921:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984715264:12345-0@lo:400: Request processed in 269us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596692.417929:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789596692.418580:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5880 x1876527984715264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596692.418611:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984715264:0@lo:400: 00000100:00080000:3.0:1789596692.419653:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789596692.925001:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596693.949150:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596694.461997:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596694.462036:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984716032:0@lo:41: 00000100:00100000:3.0:1789596694.462128:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596694.462304:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716032 00000100:00100000:0.0:1789596694.462316:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716032 00000100:00100000:0.0:1789596694.462391:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596694.462402:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984716032:12345-0@lo:41: 00000004:00000024:0.0:1789596694.462447:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789596694.462505:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984716032:12345-0@lo:41: Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596694.462513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789596694.462614:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984716032:0@lo:41: 00010000:00010000:2.0:1789596694.972954:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596695.444874:0:9874:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1789596695.484884:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789596695.484895:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7ebaf79000 from 39 10000000:01000000:1.0:1789596695.484903:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596695.484961:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.484976:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.484989:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596695.485018:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716160:0@lo:101: 00000100:00100000:1.0:1789596695.485108:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.485171:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.485201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716160 00000100:00100000:1.0:1789596695.485211:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716160 00000100:00100000:1.0:1789596695.485273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789596695.485285:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984716160:12345-0@lo:101: 00010000:00010000:1.0:1789596695.485302:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596695.485317:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe839 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.485362:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.485375:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.485386:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670000, rc 0) 00000100:00100000:1.0:1789596695.485432:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984716160:12345-0@lo:101: Request processed in 148us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.485438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789596695.485495:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716160:0@lo:101: 00010000:00010000:1.0:1789596695.485513:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.485522:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596695.485590:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716288:0@lo:501: 00000100:00100000:1.0:1789596695.485615:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.485641:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.486120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716288 00000100:00100000:2.0:1789596695.486128:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716288 00000100:00100000:2.0:1789596695.486176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789596695.486185:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984716288:12345-0@lo:501: 00000100:00100000:2.0:1789596695.486369:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984716288:12345-0@lo:501: Request processed in 184us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.486376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789596695.486418:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716288:0@lo:501: 00000100:00100000:2.0:1789596695.486456:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716416:0@lo:503: 00000100:00100000:2.0:1789596695.486500:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.486525:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.486544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716416 00000100:00100000:2.0:1789596695.486549:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716416 00000100:00100000:2.0:1789596695.486573:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789596695.486579:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984716416:12345-0@lo:503: 00000100:00100000:2.0:1789596695.486665:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984716416:12345-0@lo:503: Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.486672:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789596695.486732:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716416:0@lo:503: 00000100:00100000:2.0:1789596695.487226:0:9877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9877:1876527984716544:0@lo:502: 00000100:00100000:2.0:1789596695.487268:0:9877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.487291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716544 00000100:00100000:2.0:1789596695.487296:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716544 00000100:00100000:2.0:1789596695.487429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789596695.487438:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9877:x1876527984716544:12345-0@lo:502: 00000100:00100000:2.0:1789596695.487530:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:9877:x1876527984716544:12345-0@lo:502: Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.487537:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789596695.487576:0:9877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.487590:0:9877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9877:1876527984716544:0@lo:502: 00000100:00100000:2.0:1789596695.487634:0:9877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9877:1876527984716672:0@lo:502: 00000100:00100000:2.0:1789596695.487668:0:9877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.487709:0:9877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.490154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716672 00000100:00100000:0.0:1789596695.490170:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716672 00000100:00100000:0.0:1789596695.490231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789596695.490242:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:9877:x1876527984716672:12345-0@lo:502: 00000100:00100000:0.0:1789596695.490452:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:9877:x1876527984716672:12345-0@lo:502: Request processed in 212us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.490461:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789596695.493719:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984716800:0@lo:13: 00000100:00100000:1.0:1789596695.493824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.493902:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716800 00000100:00100000:1.0:1789596695.493911:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716800 00000100:00100000:2.0:1789596695.493942:0:9877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9877:1876527984716672:0@lo:502: 00000100:00100000:1.0:1789596695.493979:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596695.493988:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984716800:12345-0@lo:13: 00000040:00080000:2.0:1789596695.493992:0:9877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00002000:00000024:1.0:1789596695.494031:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596695.494077:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984716800:12345-0@lo:13: Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.494085:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000000:2.0:1789596695.494088:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 00000100:00080000:1.0:1789596695.494108:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1789596695.494113:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789596695.494131:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789596695.494131:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b5180 x1876527984716800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789596695.494144:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596695.494148:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984716800:0@lo:13: 10000000:01000000:2.0:1789596695.494156:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789596695.494159:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789596695.494162:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789596695.494191:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.494200:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.494212:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596695.494228:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716928:0@lo:101: 00000100:00100000:2.0:1789596695.494262:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.494300:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.494318:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984716928 00000100:00100000:1.0:1789596695.494322:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984716928 00000100:00100000:1.0:1789596695.494350:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596695.494357:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984716928:12345-0@lo:101: 00010000:00010000:1.0:1789596695.494367:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596695.494383:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe847 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.494408:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.494419:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.494429:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670200, rc 0) 00000100:00100000:1.0:1789596695.494460:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984716928:12345-0@lo:101: Request processed in 103us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.494466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596695.494499:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984716928:0@lo:101: 00010000:00010000:1.0:1789596695.494522:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.494532:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596695.494594:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717056:0@lo:501: 00000100:00100000:1.0:1789596695.494621:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596695.495946:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984717184:0@lo:13: 00000100:00100000:3.0:1789596695.496010:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.497583:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717184 00000100:00100000:2.0:1789596695.497601:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717184 00000100:00100000:2.0:1789596695.500870:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596695.500902:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984717184:12345-0@lo:13: 00002000:00000024:2.0:1789596695.500942:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596695.501064:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984717184:12345-0@lo:13: Request processed in 176us (5054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.501072:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789596695.501125:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596695.502143:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b03c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789596695.502278:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820ab800 x1876527984717184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596695.502305:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984717184:0@lo:13: 00000100:00100000:0.0:1789596695.502305:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717056 00000100:00100000:0.0:1789596695.502315:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717056 00000100:00100000:0.0:1789596695.502387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789596695.502397:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984717056:12345-0@lo:501: 00000100:00100000:0.0:1789596695.502595:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984717056:12345-0@lo:501: Request processed in 199us (7972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.502604:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789596695.503633:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717056:0@lo:501: 00000100:00100000:3.0:1789596695.503711:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717312:0@lo:503: 00000100:00100000:3.0:1789596695.503774:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596695.503841:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d837109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.503984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717312 00000100:00100000:0.0:1789596695.503991:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717312 00000100:00100000:0.0:1789596695.504041:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789596695.504049:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984717312:12345-0@lo:503: 00000100:00100000:0.0:1789596695.504162:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984717312:12345-0@lo:503: Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.504169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789596695.504210:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717312:0@lo:503: 00000100:00100000:0.0:1789596695.504433:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9879:1876527984717440:0@lo:502: 00000100:00100000:0.0:1789596695.504478:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.504495:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717440 00000100:00100000:0.0:1789596695.504498:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717440 00000100:00100000:0.0:1789596695.504513:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789596695.504518:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:9879:x1876527984717440:12345-0@lo:502: 00000100:00100000:0.0:1789596695.504587:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:9879:x1876527984717440:12345-0@lo:502: Request processed in 67us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.504593:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789596695.504617:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f11d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.504629:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9879:1876527984717440:0@lo:502: 00000020:01000000:0.0:1789596695.504656:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596695.504667:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596695.504669:0:9879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789596695.504673:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789596695.504675:0:9879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789596695.504712:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9879:1876527984717568:0@lo:502: 00000100:00100000:0.0:1789596695.504740:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.504755:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717568 00000100:00100000:0.0:1789596695.504758:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717568 00000100:00100000:0.0:1789596695.504772:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789596695.504776:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:9879:x1876527984717568:12345-0@lo:502: 00000100:00100000:0.0:1789596695.504840:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:9879:x1876527984717568:12345-0@lo:502: Request processed in 63us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.504846:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789596695.504867:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f11d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.504877:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9879:1876527984717568:0@lo:502: 00000020:01000000:0.0:1789596695.504891:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596695.504894:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596695.504895:0:9879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789596695.504898:0:9879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789596695.504950:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789596695.504973:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789596695.504982:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.504994:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596695.505004:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789596695.505012:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7eb9a66000 from 39 10000000:01000000:0.0:1789596695.505014:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596695.505040:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.505048:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.505056:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.505065:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717696:0@lo:101: 00000100:00100000:0.0:1789596695.505089:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.505100:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88073a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.505110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717696 00000100:00100000:0.0:1789596695.505113:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717696 00000100:00100000:0.0:1789596695.505127:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789596695.505131:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984717696:12345-0@lo:101: 00010000:00010000:0.0:1789596695.505140:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596695.505152:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe855 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.505174:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.505184:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.505192:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c6800, rc 0) 00000100:00100000:0.0:1789596695.505214:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984717696:12345-0@lo:101: Request processed in 83us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.505224:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789596695.505250:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717696:0@lo:101: 00010000:00010000:0.0:1789596695.505262:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.505270:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.505307:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717824:0@lo:501: 00000100:00100000:0.0:1789596695.505328:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.505338:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88073a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.505347:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717824 00000100:00100000:0.0:1789596695.505350:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717824 00000100:00100000:0.0:1789596695.505362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789596695.505367:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984717824:12345-0@lo:501: 00000100:00100000:0.0:1789596695.505461:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984717824:12345-0@lo:501: Request processed in 94us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.505467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789596695.505504:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717824:0@lo:501: 00000100:00100000:0.0:1789596695.505524:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717952:0@lo:503: 00000100:00100000:0.0:1789596695.505550:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.505561:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88073a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.505570:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984717952 00000100:00100000:0.0:1789596695.505573:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984717952 00000100:00100000:0.0:1789596695.505586:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789596695.505591:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984717952:12345-0@lo:503: 00000100:00100000:0.0:1789596695.505654:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984717952:12345-0@lo:503: Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.505660:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789596695.505713:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984717952:0@lo:503: 00000100:00100000:0.0:1789596695.507900:0:9880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9880:1876527984718080:0@lo:502: 00000100:00100000:0.0:1789596695.507990:0:9880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.508044:0:9880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596695.508097:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718080 00000100:00100000:3.0:1789596695.508107:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718080 00000100:00100000:3.0:1789596695.508162:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789596695.508172:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:9880:x1876527984718080:12345-0@lo:502: 00000100:00100000:3.0:1789596695.508303:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:9880:x1876527984718080:12345-0@lo:502: Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596695.508310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789596695.508488:0:9880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9880:1876527984718080:0@lo:502: 00000100:00100000:0.0:1789596695.508545:0:9880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9880:1876527984718208:0@lo:502: 00000100:00100000:0.0:1789596695.508579:0:9880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.508602:0:9880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.511927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718208 00000100:00100000:2.0:1789596695.511947:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718208 00000100:00100000:2.0:1789596695.512026:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789596695.512039:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:9880:x1876527984718208:12345-0@lo:502: 00000100:00100000:2.0:1789596695.512266:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:9880:x1876527984718208:12345-0@lo:502: Request processed in 230us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.512275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789596695.513010:0:9880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9880:1876527984718208:0@lo:502: 00000040:00080000:1.0:1789596695.513062:0:9880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789596695.513569:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789596695.513610:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596695.513624:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.513639:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596695.513650:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789596695.513653:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb9a66000 from 6 10000000:01000000:0.0:1789596695.513656:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596695.513734:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.513745:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.513774:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.513813:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718336:0@lo:101: 00000100:00100000:0.0:1789596695.513884:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.513934:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928480 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.515480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718336 00000100:00100000:1.0:1789596695.515494:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718336 00000100:00100000:1.0:1789596695.515555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789596695.515565:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984718336:12345-0@lo:101: 00010000:00010000:1.0:1789596695.515583:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596695.515605:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670a00/0x7b5398e289bbe86a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe863 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.515640:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670a00/0x7b5398e289bbe86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe863 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.515653:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670a00/0x7b5398e289bbe86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe863 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.515664:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670a00, rc 0) 00000100:00100000:1.0:1789596695.515762:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984718336:12345-0@lo:101: Request processed in 198us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.515781:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789596695.521101:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718336:0@lo:101: 00010000:00010000:2.0:1789596695.521140:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.521157:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596695.521249:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718464:0@lo:256: 00000100:00100000:2.0:1789596695.521334:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.521397:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.521465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718464 00000100:00100000:0.0:1789596695.521474:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718464 00000100:00100000:0.0:1789596695.521542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789596695.521553:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984718464:12345-0@lo:256: 20000000:01000000:0.0:1789596695.521581:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596695.521603:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596695.521606:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789596695.521740:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984718464:12345-0@lo:256: Request processed in 188us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.521749:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789596695.521848:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718464:0@lo:256: 10000000:01000000:2.0:1789596695.521900:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596695.521909:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.521920:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596695.521930:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789596695.521934:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789596695.521936:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789596695.521971:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.521980:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.521991:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596695.522005:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718592:0@lo:101: 00000100:00100000:2.0:1789596695.522033:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.522059:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.522104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718592 00000100:00100000:0.0:1789596695.522109:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718592 00000100:00100000:0.0:1789596695.522143:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789596695.522151:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984718592:12345-0@lo:101: 00010000:00010000:0.0:1789596695.522161:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596695.522176:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe871 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.522199:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.522210:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.522227:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c7a00, rc 0) 00000100:00100000:0.0:1789596695.522256:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984718592:12345-0@lo:101: Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.522263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789596695.522328:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718592:0@lo:101: 00010000:00010000:2.0:1789596695.522341:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.522350:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596695.522412:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718720:0@lo:501: 00000100:00100000:2.0:1789596695.522438:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.522459:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.522499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718720 00000100:00100000:0.0:1789596695.522504:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718720 00000100:00100000:0.0:1789596695.522534:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789596695.522541:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984718720:12345-0@lo:501: 00000100:00100000:0.0:1789596695.522671:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984718720:12345-0@lo:501: Request processed in 130us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.522707:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789596695.522786:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718720:0@lo:501: 00000100:00100000:2.0:1789596695.522829:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718848:0@lo:503: 00000100:00100000:2.0:1789596695.522871:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.522895:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bedb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.522934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718848 00000100:00100000:0.0:1789596695.522939:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718848 00000100:00100000:0.0:1789596695.522968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789596695.522974:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984718848:12345-0@lo:503: 00000100:00100000:0.0:1789596695.523062:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984718848:12345-0@lo:503: Request processed in 88us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.523069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789596695.524412:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984718848:0@lo:503: 00000100:00100000:2.0:1789596695.524902:0:9882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9882:1876527984718976:0@lo:502: 00000100:00100000:2.0:1789596695.524974:0:9882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.525004:0:9882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.525057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984718976 00000100:00100000:0.0:1789596695.525064:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984718976 00000100:00100000:0.0:1789596695.525116:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789596695.525125:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:9882:x1876527984718976:12345-0@lo:502: 00000100:00100000:0.0:1789596695.525252:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:9882:x1876527984718976:12345-0@lo:502: Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.525260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789596695.525313:0:9882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9882:1876527984718976:0@lo:502: 00000020:01000000:0.0:1789596695.525338:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789596695.525347:0:9882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789596695.525355:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596695.525358:0:9882:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789596695.525362:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789596695.525366:0:9882:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:0.0:1789596695.525394:0:9882:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789596695.525396:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789596695.525412:0:9882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c7e9e3599c0) 00000020:00000080:0.0:1789596695.525442:0:9882:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789596695.525447:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789596695.525543:0:9882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789596695.525551:0:9882:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789596695.525559:0:9882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbe886 00010000:00080000:0.0:1789596695.525593:0:9882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d8365d800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789596695.525895:0:9882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789596695.526064:0:9882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789596695.526079:0:9882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789596695.526293:0:9882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596695.526429:0:9882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596695.526599:0:9882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789596695.526736:0:9882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789596695.534373:0:9883:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596695.534384:0:9883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789596695.535643:0:9882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789596695.535661:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789596695.535741:0:9882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789596695.535776:0:9882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe88d 00000100:00080000:2.0:1789596695.535789:0:9882:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596695.535814:0:9882:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7d8365d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596695.535863:0:9882:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d836d6a00 x1876527984719104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596695.535889:0:9882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789596695.535955:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596695.535960:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596695.535962:0:9882:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789596695.535965:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596695.535969:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596695.535971:0:9882:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596695.535973:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596695.535976:0:9882:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789596695.536012:0:9882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9882:1876527984719232:0@lo:502: 00000100:00100000:2.0:1789596695.536112:0:9882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.536157:0:9882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.536355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984719104:0@lo:8: 00000100:00100000:0.0:1789596695.536394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.536446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719232 00000100:00100000:0.0:1789596695.536455:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719232 00000100:00100000:0.0:1789596695.536511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789596695.536521:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:9882:x1876527984719232:12345-0@lo:502: 00000100:00100000:1.0:1789596695.536525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984719360:0@lo:400: 00000100:00100000:1.0:1789596695.536587:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.536610:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984719872:0@lo:400: 00000100:00100000:2.0:1789596695.536701:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719104 00000100:00100000:2.0:1789596695.536706:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719104 00000100:00100000:0.0:1789596695.545195:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:9882:x1876527984719232:12345-0@lo:502: Request processed in 8659us (9067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.545233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789596695.545540:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596695.545552:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984719104:12345-0@lo:8: 00010000:00080000:2.0:1789596695.545600:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1789596695.545652:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbe894 00002000:00100000:2.0:1789596695.545670:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c7d8365e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789596695.545675:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1789596695.545709:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789596695.545790:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789596695.546098:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789596695.546138:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d8365d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596695.546224:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984719104:12345-0@lo:8: Request processed in 671us (9828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.546231:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596695.546293:0:9882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9882:1876527984719232:0@lo:502: 00000020:01000000:2.0:1789596695.546336:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596695.546344:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596695.546347:0:9882:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789596695.546353:0:9882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00010000:00080000:0.0:1789596695.547963:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d6a00 x1876527984719104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596695.547982:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596695.547994:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789596695.548006:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789596695.548029:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789596695.548035:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d8365d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789596695.548065:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789596695.548072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984719104:0@lo:8: 00000020:01000000:0.0:1789596695.548114:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789596695.548153:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789596695.548165:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548179:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596695.548192:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789596695.548196:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e867d5800 from 39 10000000:01000000:0.0:1789596695.548200:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596695.548250:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548259:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548270:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.548314:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984720384:0@lo:101: 00000100:00100000:0.0:1789596695.548392:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.548436:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.548457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720384 00000100:00100000:0.0:1789596695.548465:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720384 00000100:00100000:0.0:1789596695.548516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789596695.548526:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984720384:12345-0@lo:101: 00010000:00010000:0.0:1789596695.548542:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596695.548557:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe89b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548585:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548598:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548608:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c6c00, rc 0) 00000100:00100000:0.0:1789596695.548646:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984720384:12345-0@lo:101: Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.548654:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789596695.548725:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984720384:0@lo:101: 00010000:00010000:0.0:1789596695.548739:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.548749:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.548831:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984720512:0@lo:501: 00000100:00100000:0.0:1789596695.548856:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.548869:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.548880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720512 00000100:00100000:0.0:1789596695.548883:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720512 00000100:00100000:0.0:1789596695.548904:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789596695.548910:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984720512:12345-0@lo:501: 00000100:00100000:0.0:1789596695.549067:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984720512:12345-0@lo:501: Request processed in 156us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.549074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789596695.549109:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984720512:0@lo:501: 00000100:00100000:0.0:1789596695.549135:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984720640:0@lo:503: 00000100:00100000:0.0:1789596695.549177:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.549189:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.549200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720640 00000100:00100000:0.0:1789596695.549204:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720640 00000100:00100000:0.0:1789596695.549226:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789596695.549232:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984720640:12345-0@lo:503: 00000100:00100000:0.0:1789596695.549318:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984720640:12345-0@lo:503: Request processed in 86us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.549325:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789596695.549367:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984720640:0@lo:503: 00000100:00100000:0.0:1789596695.549647:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9885:1876527984720768:0@lo:502: 00000100:00100000:0.0:1789596695.549705:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.549731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720768 00000100:00100000:0.0:1789596695.549735:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720768 00000100:00100000:0.0:1789596695.549756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789596695.549761:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:9885:x1876527984720768:12345-0@lo:502: 00000100:00100000:0.0:1789596695.549876:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:9885:x1876527984720768:12345-0@lo:502: Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.549882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789596695.549911:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.549923:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9885:1876527984720768:0@lo:502: 00000100:00100000:0.0:1789596695.549967:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9885:1876527984720896:0@lo:502: 00000100:00100000:0.0:1789596695.550000:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.550019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720896 00000100:00100000:0.0:1789596695.550023:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720896 00000100:00100000:0.0:1789596695.550044:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789596695.550050:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:9885:x1876527984720896:12345-0@lo:502: 00000100:00100000:0.0:1789596695.550109:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:9885:x1876527984720896:12345-0@lo:502: Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.550115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789596695.550148:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.550160:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9885:1876527984720896:0@lo:502: 00000040:00080000:0.0:1789596695.550178:0:9885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789596695.550235:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789596695.550252:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596695.550260:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550270:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596695.550287:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789596695.550290:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7e867d5800 from 6 10000000:01000000:0.0:1789596695.550292:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596695.550313:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550320:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550329:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.550341:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721024:0@lo:101: 00000100:00100000:0.0:1789596695.550366:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.550381:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.550390:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721024 00000100:00100000:0.0:1789596695.550393:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721024 00000100:00100000:0.0:1789596695.550411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789596695.550416:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984721024:12345-0@lo:101: 00010000:00010000:0.0:1789596695.550425:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596695.550437:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7e00/0x7b5398e289bbe8b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe8a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550456:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7e00/0x7b5398e289bbe8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe8a9 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550468:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c7e00/0x7b5398e289bbe8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe8a9 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550486:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c7e00, rc 0) 00000100:00100000:0.0:1789596695.550515:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984721024:12345-0@lo:101: Request processed in 98us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.550521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789596695.550551:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721024:0@lo:101: 00010000:00010000:0.0:1789596695.550563:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.550572:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.550614:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721152:0@lo:256: 00000100:00100000:0.0:1789596695.550645:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.550659:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.550673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721152 00000100:00100000:0.0:1789596695.550700:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721152 00000100:00100000:0.0:1789596695.550722:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789596695.550729:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984721152:12345-0@lo:256: 20000000:01000000:0.0:1789596695.550743:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596695.550763:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596695.550767:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000004:00080000:2.0:1789596695.551345:0:9883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789596695.551445:0:9883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 270369766137ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789596695.551455:0:9883:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789596695.551522:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984721280:0@lo:700: 00000100:00100000:1.0:1789596695.553081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984719488:0@lo:400: 00000100:00100000:2.0:1789596695.559559:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.559657:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721280 00000100:00100000:2.0:1789596695.559670:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721280 00000100:00100000:2.0:1789596695.559771:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596695.559783:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9884:x1876527984721280:12345-0@lo:700: 00000100:00100000:2.0:1789596695.559871:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1876527984721408:0@lo:700: 00000100:00100000:2.0:1789596695.559926:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.559956:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed600 going to sleep for 11 seconds 00000100:00080000:2.0:1789596695.559980:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596695.559989:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed840 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.560125:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.560159:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984720000:0@lo:400: 00000100:00100000:1.0:1789596695.560187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.560215:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719488 00000100:00100000:0.0:1789596695.560220:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719488 00000100:00100000:1.0:1789596695.560223:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984719616:0@lo:400: 00000100:00100000:1.0:1789596695.560248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.560255:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596695.560262:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984719488:12345-0@lo:400: 00000100:00100000:1.0:1789596695.560266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984720128:0@lo:400: 00000100:00100000:1.0:1789596695.560285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.560303:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789596695.560309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984719744:0@lo:400: 00000100:00100000:0.0:1789596695.560319:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984719488:12345-0@lo:400: Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.560330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.560333:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789596695.560341:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984720256:0@lo:400: 00000100:00100000:0.0:1789596695.560354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719744 00000100:00100000:0.0:1789596695.560357:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719744 00000100:00100000:1.0:1789596695.560363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.560372:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596695.560377:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984719744:12345-0@lo:400: 00000100:00100000:1.0:1789596695.560397:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719360 00000100:00100000:1.0:1789596695.560401:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719360 00000100:00100000:0.0:1789596695.560412:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984719744:12345-0@lo:400: Request processed in 35us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.560417:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789596695.560424:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720000 00000100:00100000:1.0:1789596695.560427:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720000 00000100:00100000:1.0:1789596695.560447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719616 00000100:00100000:1.0:1789596695.560450:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719616 00000100:00100000:0.0:1789596695.560522:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984721152:12345-0@lo:256: Request processed in 9793us (9875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.560532:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789596695.560600:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721152:0@lo:256: 00000100:00100000:3.0:1789596695.560781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721408 00000100:00100000:3.0:1789596695.560786:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721408 00000100:00100000:3.0:1789596695.560841:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596695.560849:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1876527984721408:12345-0@lo:700: 10000000:01000000:0.0:1789596695.560938:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789596695.560949:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.560963:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596695.560974:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789596695.560976:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789596695.560980:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596695.561010:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.561019:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.561040:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.561055:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721536:0@lo:101: 00000100:00100000:0.0:1789596695.561085:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.561112:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.562733:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720128 00000100:00100000:1.0:1789596695.562751:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720128 00000100:00100000:1.0:1789596695.562792:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984720256 00000100:00100000:1.0:1789596695.562822:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984720256 00000100:00100000:1.0:1789596695.562858:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789596695.562868:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984719360:12345-0@lo:400: 00000100:00100000:1.0:1789596695.562976:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984719360:12345-0@lo:400: Request processed in 110us (26387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.562983:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789596695.563002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789596695.563010:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984720000:12345-0@lo:400: 00000100:00100000:1.0:1789596695.563043:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984720000:12345-0@lo:400: Request processed in 34us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.563049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789596695.563061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789596695.563068:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984719616:12345-0@lo:400: 00000100:00100000:1.0:1789596695.563098:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984719616:12345-0@lo:400: Request processed in 31us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.563104:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789596695.563115:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789596695.563121:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3644:x1876527984720128:12345-0@lo:400: 00000100:00100000:1.0:1789596695.563149:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3644:x1876527984720128:12345-0@lo:400: Request processed in 27us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.563155:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789596695.563166:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789596695.563172:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984720256:12345-0@lo:400: 00000100:00100000:1.0:1789596695.563201:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984720256:12345-0@lo:400: Request processed in 29us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.563206:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789596695.563322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984719488:0@lo:400: 00010000:00080000:1.0:1789596695.563339:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6300 x1876527984720000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.563350:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984720000:0@lo:400: 00000100:00100000:1.0:1789596695.563390:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984719744:0@lo:400: 00010000:00080000:1.0:1789596695.563402:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6680 x1876527984720256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.563410:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984720256:0@lo:400: 00010000:00080000:1.0:1789596695.563420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b5f80 x1876527984719616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.563428:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984719616:0@lo:400: 00010000:00080000:1.0:1789596695.563438:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6a00 x1876527984720128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.563446:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984720128:0@lo:400: 00000004:00080000:2.0:1789596695.564526:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:1.0:1789596695.565093:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596695.565102:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596695.565121:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721536 00000100:00100000:1.0:1789596695.565132:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721536 00000100:00100000:1.0:1789596695.565192:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789596695.565203:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984721536:12345-0@lo:101: 00010000:00010000:1.0:1789596695.565224:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596695.565250:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe8b7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.565286:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.565313:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.565337:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670400, rc 0) 00000100:00100000:1.0:1789596695.565425:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984721536:12345-0@lo:101: Request processed in 224us (4338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.565432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789596695.569407:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721536:0@lo:101: 00010000:00010000:0.0:1789596695.569451:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596695.569468:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.569895:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721664:0@lo:501: 00000100:00100000:1.0:1789596695.569976:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.569976:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:2.0:1789596695.573196:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1789596695.575961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721664 00000100:00100000:3.0:1789596695.575986:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721664 00000100:00100000:3.0:1789596695.576074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789596695.576086:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984721664:12345-0@lo:501: 00000100:00100000:1.0:1789596695.577740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984719872 00000100:00100000:1.0:1789596695.577758:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984719872 00000100:00100000:1.0:1789596695.577932:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789596695.577944:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984719872:12345-0@lo:400: 00000100:00100000:1.0:1789596695.578041:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984719872:12345-0@lo:400: Request processed in 99us (8063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.578049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789596695.578076:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789596695.578120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b5180 x1876527984719872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.578138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984719872:0@lo:400: 00010000:00080000:1.0:1789596695.578178:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b4a80 x1876527984719360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.578189:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984719360:0@lo:400: 00000100:00100000:0.0:1789596695.583419:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.585248:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1876527984721408:12345-0@lo:700: Request processed in 24386us (25307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.585267:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789596695.585429:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d6d80 x1876527984721408/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596695.585450:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1876527984721408:0@lo:700: 40000000:02000000:0.0:1789596695.585471:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1789596695.586416:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984721664:12345-0@lo:501: Request processed in 10326us (16434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596695.586430:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789596695.592391:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721664:0@lo:501: 00000100:00100000:3.0:1789596695.595543:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721792:0@lo:503: 00000100:00100000:3.0:1789596695.595665:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596695.595743:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d837106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.597008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721792 00000100:00100000:1.0:1789596695.597028:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721792 00000100:00100000:1.0:1789596695.597273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789596695.597285:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984721792:12345-0@lo:503: 00000100:00100000:1.0:1789596695.598705:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984721792:12345-0@lo:503: Request processed in 1391us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.598724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789596695.599013:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984721792:0@lo:503: 00000100:00100000:1.0:1789596695.602858:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9887:1876527984721920:0@lo:502: 00000100:00100000:1.0:1789596695.602969:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.603021:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e99317d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.603088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984721920 00000100:00100000:2.0:1789596695.603099:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984721920 00000100:00100000:2.0:1789596695.603163:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789596695.603174:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:9887:x1876527984721920:12345-0@lo:502: 00000100:00100000:2.0:1789596695.603333:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:9887:x1876527984721920:12345-0@lo:502: Request processed in 160us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.603342:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789596695.603408:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9887:1876527984721920:0@lo:502: 00000020:01000000:2.0:1789596695.603444:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596695.603453:0:9887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789596695.603462:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596695.603465:0:9887:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789596695.603471:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789596695.603477:0:9887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789596695.603504:0:9887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789596695.603506:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596695.603526:0:9887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c7d820c99c0) 00000020:00000080:2.0:1789596695.603556:0:9887:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789596695.603561:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789596695.603652:0:9887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789596695.603660:0:9887:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789596695.603668:0:9887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbe8cc 00010000:00080000:2.0:1789596695.603746:0:9887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d8318a800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789596695.604051:0:9887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789596695.604217:0:9887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789596695.604231:0:9887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789596695.604430:0:9887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789596695.604543:0:9887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789596695.604712:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789596695.604819:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789596695.614192:0:9888:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596695.614207:0:9888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789596695.618294:0:9887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596695.618328:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789596695.618379:0:9887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789596695.618408:0:9887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe8d3 00000100:00080000:1.0:1789596695.618419:0:9887:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596695.618432:0:9887:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7d8318a800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596695.618468:0:9887:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83697100 x1876527984722048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596695.618496:0:9887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789596695.618557:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984722048:0@lo:8: 00000020:01000000:1.0:1789596695.618565:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596695.618572:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596695.618573:0:9887:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789596695.618577:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596695.618580:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596695.618582:0:9887:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789596695.618585:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789596695.618587:0:9887:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789596695.618616:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9887:1876527984722176:0@lo:502: 00000100:00100000:1.0:1789596695.621269:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.621734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.621736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722176 00000100:00100000:1.0:1789596695.621770:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722176 00000100:00100000:1.0:1789596695.621875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789596695.621878:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722048 00000100:00100000:0.0:1789596695.621890:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722048 00000100:00100000:1.0:1789596695.621892:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:9887:x1876527984722176:12345-0@lo:502: 00000100:00100000:0.0:1789596695.621935:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596695.621957:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876527984722048:12345-0@lo:8: 00010000:00080000:0.0:1789596695.622002:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000100:00100000:1.0:1789596695.622090:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:9887:x1876527984722176:12345-0@lo:502: Request processed in 203us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.622099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789596695.622192:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e993176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.622222:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:9887:1876527984722176:0@lo:502: 00000020:01000000:1.0:1789596695.622262:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596695.622270:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596695.622273:0:9887:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789596695.622280:0:9887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:00000080:0.0:1789596695.622440:0:8436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbe8da 00002000:00100000:0.0:1789596695.622465:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c7d83c1a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789596695.622471:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789596695.622475:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789596695.623154:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596695.623192:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596695.623294:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984722048:12345-0@lo:8: Request processed in 1335us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.623305:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789596695.623429:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83697100 x1876527984722048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.623442:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789596695.623451:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789596695.623460:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789596695.623466:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789596695.623470:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789596695.623491:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789596695.623499:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984722048:0@lo:8: 00000004:00080000:1.0:1789596695.623543:0:9888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789596695.623627:0:9888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 270441948153ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789596695.623634:0:9888:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:3.0:1789596695.626466:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789596695.626662:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9884:x1876527984721280:12345-0@lo:700: Request processed in 66873us (67108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.626702:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1789596695.627949:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789596695.628003:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789596695.628018:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.628032:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596695.628044:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789596695.628048:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7e88948000 from 1 10000000:01000000:2.0:1789596695.628051:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596695.628099:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.628109:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.628121:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596695.628151:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984722304:0@lo:101: 00000100:00100000:2.0:1789596695.628227:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.628287:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.628296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722304 00010000:00080000:2.0:1789596695.628356:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d5c00 x1876527984721280/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596695.628374:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984721280:0@lo:700: 00000100:00100000:1.0:1789596695.628441:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722304 00000100:00100000:1.0:1789596695.628506:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789596695.628517:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984722304:12345-0@lo:101: 00010000:00010000:1.0:1789596695.628535:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596695.628554:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe8e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.628584:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.628597:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596695.628608:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671400, rc 0) 00000100:00100000:1.0:1789596695.628709:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984722304:12345-0@lo:101: Request processed in 166us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.628717:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789596695.628723:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984722304:0@lo:101: 00010000:00010000:2.0:1789596695.628749:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.628761:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596695.629168:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789596695.632787:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596695.632828:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984722432:0@lo:13: 00000100:00100000:1.0:1789596695.632904:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789596695.632962:0:9889:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789596695.632968:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722432 00000100:00100000:0.0:1789596695.632984:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722432 00000100:00100000:1.0:1789596695.632990:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984722560:0@lo:7: 00000100:00100000:1.0:1789596695.633022:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.633056:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e993179c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596695.633089:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596695.633102:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984722432:12345-0@lo:13: 00002000:00000024:0.0:1789596695.633140:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789596695.633233:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984722432:12345-0@lo:13: Request processed in 134us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.633241:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789596695.633276:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596695.633287:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83697100 x1876527984722432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.633309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984722432:0@lo:13: 00000100:00100000:2.0:1789596695.634600:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722560 00000100:00100000:2.0:1789596695.634616:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722560 00000100:00100000:2.0:1789596695.634701:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596695.634713:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9889:x1876527984722560:12345-0@lo:7: 00002000:00080000:2.0:1789596695.647428:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789596695.647440:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789596695.647572:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9889:x1876527984722560:12345-0@lo:7: Request processed in 12854us (14542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.647585:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789596695.647656:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83694700 x1876527984722560/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.647727:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984722560:0@lo:7: 00000004:00080000:1.0:1789596695.647747:0:9889:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789596695.647832:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984722688:0@lo:501: 00000100:00100000:1.0:1789596695.647832:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984722816:0@lo:5: 00000100:00100000:2.0:1789596695.647910:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.647934:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.647955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722688 00000100:00100000:2.0:1789596695.647967:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722688 00000100:00100000:1.0:1789596695.647982:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e993179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.648027:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789596695.648038:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984722688:12345-0@lo:501: 00000100:00100000:2.0:1789596695.648136:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984722688:12345-0@lo:501: Request processed in 100us (228us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596695.648157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789596695.648207:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.648226:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984722688:0@lo:501: 10000000:01000000:2.0:1789596695.648266:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789596695.648278:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596695.648290:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596695.648533:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722816 00000100:00100000:0.0:1789596695.648538:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722816 00000100:00100000:0.0:1789596695.648735:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596695.648750:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9889:x1876527984722816:12345-0@lo:5: 00002000:00080000:0.0:1789596695.648779:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789596695.648784:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789596695.657349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984722944:0@lo:13: 00000100:00100000:3.0:1789596695.657433:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789596695.657551:0:9884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789596695.657577:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984723072:0@lo:7: 00000100:00100000:1.0:1789596695.657611:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.657630:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9938af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.657652:0:8437:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789596695.657660:0:8437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789596695.658941:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723072 00000100:00100000:1.0:1789596695.658952:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723072 00000100:00100000:3.0:1789596695.659132:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596695.659143:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9884:x1876527984723072:12345-0@lo:7: 00000100:00100000:1.0:1789596695.660917:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984722944 00000100:00100000:1.0:1789596695.660929:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984722944 00000100:00100000:1.0:1789596695.660985:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596695.660994:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984722944:12345-0@lo:13: 00002000:00000024:1.0:1789596695.661020:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789596695.661120:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984722944:12345-0@lo:13: Request processed in 125us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.661127:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789596695.661213:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83696300 x1876527984722944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.661237:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984722944:0@lo:13: 00000001:00080000:0.0:1789596695.665790:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789596695.665825:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789596695.666009:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9889:x1876527984722816:12345-0@lo:5: Request processed in 17257us (18070us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789596695.666247:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789596695.666567:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83694700 x1876527984722816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.666596:0:9889:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789596695.666604:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984722816:0@lo:5: 00000004:00080000:1.0:1789596695.666621:0:9889:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789596695.666672:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984723200:0@lo:700: 00000100:00100000:1.0:1789596695.666758:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596695.667435:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e993179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.667470:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723200 00000100:00100000:1.0:1789596695.667478:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723200 00000100:00100000:1.0:1789596695.667552:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596695.667570:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9889:x1876527984723200:12345-0@lo:700: 00002000:00080000:3.0:1789596695.669509:0:9893:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789596695.669519:0:9893:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789596695.669630:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9884:x1876527984723072:12345-0@lo:7: Request processed in 10486us (12014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596695.669640:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789596695.669807:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83695180 x1876527984723072/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596695.669837:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984723072:0@lo:7: 00000004:00080000:2.0:1789596695.669860:0:9884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789596695.669920:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984723328:0@lo:5: 00000100:00100000:2.0:1789596695.669989:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.670028:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.670054:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723328 00000100:00100000:2.0:1789596695.670062:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723328 00000100:00100000:2.0:1789596695.670125:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596695.670141:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9884:x1876527984723328:12345-0@lo:5: 00002000:00080000:2.0:1789596695.670181:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789596695.670230:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9884:x1876527984723328:12345-0@lo:5: Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.670238:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789596695.670282:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d7100 x1876527984723328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596695.670301:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984723328:0@lo:5: 00000004:00080000:2.0:1789596695.670312:0:9884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789596695.670354:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984723456:0@lo:5: 00000100:00100000:2.0:1789596695.670380:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.670398:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82bed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.670412:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723456 00000100:00100000:2.0:1789596695.670416:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723456 00000100:00100000:2.0:1789596695.670447:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596695.670454:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9884:x1876527984723456:12345-0@lo:5: 00002000:00080000:2.0:1789596695.670497:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789596695.672782:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9884:x1876527984723456:12345-0@lo:5: Request processed in 2318us (2391us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1789596695.672851:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d7100 x1876527984723456/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596695.672874:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1876527984723456:0@lo:5: 00000004:00080000:3.0:1789596695.672899:0:9884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789596695.672948:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9884:1876527984723584:0@lo:900: 00000100:00100000:3.0:1789596695.673008:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596695.673048:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596695.673172:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723584 00000100:00100000:1.0:1789596695.673180:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723584 00000100:00100000:1.0:1789596695.673243:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596695.673253:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9884:x1876527984723584:12345-0@lo:900: 00000100:00100000:1.0:1789596695.673312:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9884:x1876527984723584:12345-0@lo:900: Request processed in 61us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596695.673603:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789596695.673643:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b7b80 x1876527984723584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596695.673656:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9884:1876527984723584:0@lo:900: 00000100:00100000:2.0:1789596695.677191:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00080000:0.0:1789596695.692505:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00080000:0.0:1789596695.692897:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83694700 x1876527984723200/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596695.692917:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984723200:0@lo:700: 00000100:00100000:2.0:1789596695.694465:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9889:x1876527984723200:12345-0@lo:700: Request processed in 26887us (27689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.694484:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:02000040:0.0:1789596695.695875:0:9889:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789596695.701012:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984723712:0@lo:5: 00000100:00100000:0.0:1789596695.701096:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.701155:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596695.701353:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723712 00000100:00100000:2.0:1789596695.701446:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723712 00000100:00100000:2.0:1789596695.701581:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789596695.701593:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9889:x1876527984723712:12345-0@lo:5: 00002000:00080000:0.0:1789596695.708730:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789596695.708756:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789596695.711296:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9889:x1876527984723712:12345-0@lo:5: Request processed in 9699us (10194us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789596695.711312:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789596695.711454:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b0e00 x1876527984723712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596695.711472:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1876527984723712:0@lo:5: 00000004:00080000:0.0:1789596695.711490:0:9889:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789596695.997774:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789596696.386504:0:9938:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596696.387434:0:9938:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789596697.023941:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789596697.441371:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789596697.533534:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596697.533570:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984723840:0@lo:41: 00000100:00100000:3.0:1789596697.533645:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596697.534237:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723840 00000100:00100000:0.0:1789596697.534259:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723840 00000100:00100000:0.0:1789596697.535032:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789596697.535047:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984723840:12345-0@lo:41: 00000004:00000024:0.0:1789596697.535085:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596697.535185:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984723840:12345-0@lo:41: Request processed in 143us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596697.535191:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789596697.535293:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984723840:0@lo:41: 00010000:00010000:2.0:1789596698.052460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596699.069106:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596699.581893:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596699.581921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984723968:0@lo:41: 00000100:00100000:3.0:1789596699.582005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596699.582111:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984723968 00000100:00100000:0.0:1789596699.582132:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984723968 00000100:00100000:0.0:1789596699.582187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789596699.582197:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984723968:12345-0@lo:41: 00000004:00000024:0.0:1789596699.582249:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789596699.582315:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984723968:12345-0@lo:41: Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596699.582322:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789596699.582413:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984723968:0@lo:41: 00000020:00000004:1.0:1789596699.659926:0:10039:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789596699.661400:0:10039:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789596700.093730:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596700.605057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984724096:0@lo:13: 00000100:00100000:1.0:1789596700.605161:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596700.605313:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724096 00000100:00100000:3.0:1789596700.605325:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724096 00000100:00100000:3.0:1789596700.605405:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789596700.605419:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984724096:12345-0@lo:13: 00002000:00000024:3.0:1789596700.605459:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596700.605517:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984724096:12345-0@lo:13: Request processed in 102us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596700.605525:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789596700.605589:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596700.605631:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5c00 x1876527984724096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596700.605653:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984724096:0@lo:13: 00000100:00100000:3.0:1789596700.606053:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596700.606067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984724224:0@lo:13: 00000100:00100000:3.0:1789596700.606109:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596700.606181:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724224 00000100:00100000:1.0:1789596700.606187:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724224 00000100:00100000:1.0:1789596700.606243:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596700.606251:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984724224:12345-0@lo:13: 00002000:00000024:1.0:1789596700.606266:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596700.606297:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984724224:12345-0@lo:13: Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596700.606304:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789596700.606412:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596700.606471:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b1f80 x1876527984724224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596700.606487:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984724224:0@lo:13: 00000020:00000004:1.0:1789596700.890265:0:10087:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789596700.890277:0:10087:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789596701.116868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596701.116922:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984724352:0@lo:13: 00000100:00100000:1.0:1789596701.117002:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596701.117067:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724352 00000100:00100000:1.0:1789596701.117074:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724352 00000100:00100000:1.0:1789596701.117130:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789596701.117140:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984724352:12345-0@lo:13: 00002000:00000024:1.0:1789596701.118544:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596701.118645:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984724352:12345-0@lo:13: Request processed in 1504us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.118656:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789596701.118725:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596701.118782:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984724480:0@lo:13: 00000100:00100000:1.0:1789596701.118818:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789596701.118867:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83697480 x1876527984724352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596701.118878:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789596701.118901:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984724352:0@lo:13: 00000100:00100000:1.0:1789596701.118937:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724480 00000100:00100000:1.0:1789596701.118942:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724480 00000100:00100000:1.0:1789596701.118996:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789596701.119004:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984724480:12345-0@lo:13: 00002000:00000024:1.0:1789596701.119015:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596701.119045:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984724480:12345-0@lo:13: Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.119051:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789596701.119078:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d7b80 x1876527984724480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596701.119086:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789596701.119099:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984724480:0@lo:13: 00010000:00010000:2.0:1789596701.119890:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596701.119908:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596701.122070:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984724608:0@lo:400: 00000100:00100000:3.0:1789596701.122159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596701.122308:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724608 00000100:00100000:2.0:1789596701.122318:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724608 00000100:00100000:2.0:1789596701.122386:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789596701.122412:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984724608:12345-0@lo:400: 00000100:00100000:0.0:1789596701.124868:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984724736:0@lo:400: 00000100:00100000:0.0:1789596701.125120:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.127241:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724736 00000100:00100000:0.0:1789596701.127259:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724736 00000100:00100000:0.0:1789596701.127332:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596701.127357:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984724736:12345-0@lo:400: 00000100:00100000:0.0:1789596701.127702:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984724736:12345-0@lo:400: Request processed in 359us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.127710:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789596701.127789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83695500 x1876527984724736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596701.127827:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984724736:0@lo:400: 00000100:00100000:0.0:1789596701.134081:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596701.134107:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984725120:0@lo:400: 00000100:00100000:0.0:1789596701.134178:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.134222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725120 00000100:00100000:0.0:1789596701.134229:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725120 00000100:00100000:0.0:1789596701.134272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789596701.134280:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984725120:12345-0@lo:400: 00000100:00100000:0.0:1789596701.134327:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984725120:12345-0@lo:400: Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.134333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789596701.134387:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984725120:0@lo:400: 00000100:00100000:0.0:1789596701.134420:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984725248:0@lo:400: 00000100:00100000:0.0:1789596701.134447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.134498:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596701.134504:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984725632:0@lo:400: 00000100:00100000:0.0:1789596701.134525:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.136395:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725248 00000100:00100000:0.0:1789596701.136411:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725248 00000100:00100000:0.0:1789596701.136485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725632 00000100:00100000:0.0:1789596701.136489:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725632 00000100:00100000:0.0:1789596701.136515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596701.136526:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984725248:12345-0@lo:400: 00000100:00100000:0.0:1789596701.136609:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984725248:12345-0@lo:400: Request processed in 86us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.136617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596701.136650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789596701.136656:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984725632:12345-0@lo:400: 00000100:00100000:0.0:1789596701.136806:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984725632:12345-0@lo:400: Request processed in 48us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.136813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789596701.136847:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984724992:0@lo:400: 00000100:00100000:0.0:1789596701.136883:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.136907:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984725504:0@lo:400: 00000100:00100000:0.0:1789596701.136929:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.136948:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789596701.136953:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984724864:0@lo:400: 00000100:00100000:0.0:1789596701.136978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.136993:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984725376:0@lo:400: 00000100:00100000:0.0:1789596701.137012:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596701.137032:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724992 00000100:00100000:0.0:1789596701.137036:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724992 00000100:00100000:0.0:1789596701.137052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725504 00000100:00100000:0.0:1789596701.137054:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725504 00000100:00100000:0.0:1789596701.137065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725376 00000100:00100000:0.0:1789596701.137067:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725376 00000100:00100000:0.0:1789596701.137078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596701.137084:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984724992:12345-0@lo:400: 00000100:00100000:0.0:1789596701.137117:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984724992:12345-0@lo:400: Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.137134:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596701.137146:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596701.137152:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984725504:12345-0@lo:400: 00000100:00100000:0.0:1789596701.137187:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984725504:12345-0@lo:400: Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.137192:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596701.137204:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596701.137210:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984725376:12345-0@lo:400: 00000100:00100000:0.0:1789596701.137412:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984725376:12345-0@lo:400: Request processed in 201us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.137418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596701.137438:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984724864 00000100:00100000:0.0:1789596701.137442:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984724864 00000100:00100000:0.0:1789596701.137467:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789596701.137474:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984724864:12345-0@lo:400: 00000100:00100000:0.0:1789596701.137506:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984724864:12345-0@lo:400: Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596701.137512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789596701.137555:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984724864:0@lo:400: 00010000:00080000:0.0:1789596701.137571:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b1880 x1876527984725376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596701.137581:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984725376:0@lo:400: 00010000:00080000:0.0:1789596701.137590:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b1f80 x1876527984724992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596701.137597:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984724992:0@lo:400: 00010000:00080000:0.0:1789596701.137606:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b1500 x1876527984725504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596701.137614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984725504:0@lo:400: 00010000:00080000:0.0:1789596701.137665:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d826c3100 x1876527984725632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596701.137675:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984725632:0@lo:400: 00010000:00080000:0.0:1789596701.138984:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b3480 x1876527984725248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596701.138998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984725248:0@lo:400: 00000100:00100000:2.0:1789596701.139128:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984724608:12345-0@lo:400: Request processed in 16716us (16966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596701.139138:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1789596701.139166:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596701.139171:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596701.140333:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984724608:0@lo:400: 00000100:00100000:0.0:1789596701.624802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.624990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604224 00000100:00100000:1.0:1789596701.625000:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604224 00000100:00100000:1.0:1789596701.625106:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:1.0:1789596701.625115:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1876527961604224:12345-192.168.202.16@tcp:250: 00010000:00080000:1.0:1789596701.625169:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 454a6744-d65e-403d-97e2-e8496b673d4c@192.168.202.16@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1789596701.625210:0:6514:0:(genops.c:1384:class_connect()) connect: client 454a6744-d65e-403d-97e2-e8496b673d4c, cookie 0x7b5398e289bbe8ef 00000100:00080000:1.0:1789596701.625405:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c2d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596701.625477:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+5:2405:x1876527961604224:12345-192.168.202.16@tcp:250: Request processed in 362us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.625496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1789596701.637876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596701.638130:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604352 00000100:00100000:2.0:1789596701.638142:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604352 00000100:00100000:2.0:1789596701.639468:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:2.0:1789596701.639486:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+5:6166:x1876527961604352:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1789596701.639502:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596701.639530:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596701.639562:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596701.639573:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596701.639582:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031a00, rc 0) 00000100:00100000:2.0:1789596701.639658:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+6:6166:x1876527961604352:12345-192.168.202.16@tcp:101: Request processed in 179us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596701.639665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:2.0:1789596701.647068:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596701.651833:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604480 00000100:00100000:0.0:1789596701.651849:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604480 00000100:00100000:0.0:1789596701.651911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:0.0:1789596701.651921:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+6:6166:x1876527961604480:12345-192.168.202.16@tcp:501: 00000100:00100000:0.0:1789596701.652065:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+6:6166:x1876527961604480:12345-192.168.202.16@tcp:501: Request processed in 145us (5007us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596701.652073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:3.0:1789596701.654597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596701.654736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604608 00000100:00100000:2.0:1789596701.654759:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604608 00000100:00100000:2.0:1789596701.654811:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:2.0:1789596701.654836:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+6:6166:x1876527961604608:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1789596701.654856:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596701.654876:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07770 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596701.654910:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596701.654923:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596701.654932:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80030600, rc 0) 00000100:00100000:2.0:1789596701.654998:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+7:6166:x1876527961604608:12345-192.168.202.16@tcp:101: Request processed in 164us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596701.655005:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:3.0:1789596701.660733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596701.661993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604736 00000100:00100000:2.0:1789596701.662007:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604736 00000100:00100000:2.0:1789596701.662069:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:2.0:1789596701.662079:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+7:6166:x1876527961604736:12345-192.168.202.16@tcp:501: 00000100:00100000:2.0:1789596701.662823:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+8:6166:x1876527961604736:12345-192.168.202.16@tcp:501: Request processed in 190us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596701.662835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:3.0:1789596701.667378:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.667477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604864 00000100:00100000:1.0:1789596701.667489:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604864 00000100:00100000:1.0:1789596701.667555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:1.0:1789596701.667566:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+8:6166:x1876527961604864:12345-192.168.202.16@tcp:503: 00000100:00100000:1.0:1789596701.667786:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+8:6166:x1876527961604864:12345-192.168.202.16@tcp:503: Request processed in 222us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.667794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:3.0:1789596701.691389:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596701.691645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961604992 00000100:00100000:2.0:1789596701.691655:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961604992 00000100:00100000:2.0:1789596701.691759:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:2.0:1789596701.691769:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+8:6185:x1876527961604992:12345-192.168.202.16@tcp:502: 00000100:00100000:2.0:1789596701.691933:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+8:6185:x1876527961604992:12345-192.168.202.16@tcp:502: Request processed in 165us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596701.691948:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:0.0:1789596701.752478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596701.753927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605120 00000100:00100000:2.0:1789596701.753942:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605120 00000100:00100000:3.0:1789596701.759494:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:3.0:1789596701.759510:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+8:6185:x1876527961605120:12345-192.168.202.16@tcp:502: 00000100:00100000:3.0:1789596701.759719:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+8:6185:x1876527961605120:12345-192.168.202.16@tcp:502: Request processed in 212us (7253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596701.759728:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:2.0:1789596701.771647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.771891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605248 00000100:00100000:1.0:1789596701.771903:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605248 00000100:00100000:1.0:1789596701.771969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:1.0:1789596701.771980:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+8:6166:x1876527961605248:12345-192.168.202.16@tcp:101: 00010000:00010000:1.0:1789596701.771998:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596701.772017:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671600/0x7b5398e289bbe904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596701.772047:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671600/0x7b5398e289bbe904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a1 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596701.772059:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671600/0x7b5398e289bbe904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a1 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596701.772067:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671600, rc 0) 00000100:00100000:1.0:1789596701.772123:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+9:6166:x1876527961605248:12345-192.168.202.16@tcp:101: Request processed in 146us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.772128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:1.0:1789596701.785283:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596701.785432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605376 00000100:00100000:3.0:1789596701.785445:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605376 00000100:00100000:3.0:1789596701.785516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:3.0:1789596701.785527:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+9:6166:x1876527961605376:12345-192.168.202.16@tcp:256: 20000000:01000000:3.0:1789596701.785559:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789596701.785581:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789596701.785586:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789596701.785590:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789596701.785593:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789596701.785595:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789596701.788804:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+9:6166:x1876527961605376:12345-192.168.202.16@tcp:256: Request processed in 3266us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596701.788819:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:2.0:1789596701.793594:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.793954:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605504 00000100:00100000:1.0:1789596701.793966:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605504 00000100:00100000:1.0:1789596701.794025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:1.0:1789596701.794035:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+9:6166:x1876527961605504:12345-192.168.202.16@tcp:101: 00010000:00010000:1.0:1789596701.794051:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596701.794068:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077a8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596701.794095:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596701.794107:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596701.794116:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671a00, rc 0) 00000100:00100000:1.0:1789596701.794861:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:6166:x1876527961605504:12345-192.168.202.16@tcp:101: Request processed in 141us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.794878:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:1.0:1789596701.803989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596701.804103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605632 00000100:00100000:3.0:1789596701.804126:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605632 00000100:00100000:3.0:1789596701.804184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:3.0:1789596701.804196:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6166:x1876527961605632:12345-192.168.202.16@tcp:501: 00000100:00100000:3.0:1789596701.804393:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6166:x1876527961605632:12345-192.168.202.16@tcp:501: Request processed in 199us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596701.804402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:0.0:1789596701.809982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.810051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605760 00000100:00100000:1.0:1789596701.810063:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605760 00000100:00100000:1.0:1789596701.810130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:1.0:1789596701.810140:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6166:x1876527961605760:12345-192.168.202.16@tcp:503: 00000100:00100000:1.0:1789596701.810504:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6166:x1876527961605760:12345-192.168.202.16@tcp:503: Request processed in 364us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.810512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:0.0:1789596701.816534:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.819399:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961605888 00000100:00100000:1.0:1789596701.819419:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961605888 00000100:00100000:1.0:1789596701.819524:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:1.0:1789596701.819536:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:6190:x1876527961605888:12345-192.168.202.16@tcp:502: 00000100:00100000:1.0:1789596701.819804:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:6190:x1876527961605888:12345-192.168.202.16@tcp:502: Request processed in 269us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.819812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:0.0:1789596701.843512:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596701.843625:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606016 00000100:00100000:3.0:1789596701.843638:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606016 00000100:00100000:3.0:1789596701.843731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:3.0:1789596701.843750:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6190:x1876527961606016:12345-192.168.202.16@tcp:502: 00000100:00100000:3.0:1789596701.843920:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6190:x1876527961606016:12345-192.168.202.16@tcp:502: Request processed in 180us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596701.843928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:0.0:1789596701.854378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596701.854428:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596701.856102:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606144 00000100:00100000:1.0:1789596701.856118:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606144 00000100:00100000:1.0:1789596701.856163:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606400 00000100:00100000:1.0:1789596701.856165:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606400 00000100:00100000:1.0:1789596701.856325:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789596701.856335:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1876527961606144:12345-192.168.202.16@tcp:38: 00000100:00100000:3.0:1789596701.856354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1789596701.856361:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1876527961606400:12345-192.168.202.16@tcp:38: 00010000:00080000:3.0:1789596701.856375:0:6519:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 276 last 0 00010000:00080000:1.0:1789596701.856375:0:8967:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1789596701.856426:0:6519:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbe919 00000020:00000080:1.0:1789596701.856426:0:8967:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbe912 00000004:00100000:3.0:1789596701.856455:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:1.0:1789596701.856502:0:8967:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789596701.856733:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9c7d837d4000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789596701.856733:0:8967:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c2a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596701.856841:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961606144:12345-192.168.202.16@tcp:38: Request processed in 504us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596701.856850:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789596701.866063:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961606400:12345-192.168.202.16@tcp:38: Request processed in 9687us (11619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596701.866080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00010000:00010000:1.0:1789596702.141295:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596702.655956:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596702.655983:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984725760:0@lo:41: 00000100:00100000:3.0:1789596702.656107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596702.656298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725760 00000100:00100000:1.0:1789596702.656308:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725760 00000100:00100000:1.0:1789596702.656368:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596702.656378:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984725760:12345-0@lo:41: 00000004:00000024:1.0:1789596702.656412:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596702.656467:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984725760:12345-0@lo:41: Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596702.656475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789596702.656611:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984725760:0@lo:41: 00000100:00100000:0.0:1789596702.867806:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596702.867898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596702.867942:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606272 00000100:00100000:1.0:1789596702.867952:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606272 00000100:00100000:1.0:1789596702.868040:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606528 00000100:00100000:1.0:1789596702.868044:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606528 00000100:00100000:1.0:1789596702.868072:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789596702.868082:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961606272:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1789596702.868142:0:8967:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789596702.868205:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961606272:12345-192.168.202.16@tcp:41: Request processed in 124us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596702.868211:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789596702.868228:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789596702.868235:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961606528:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1789596702.868247:0:8967:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596702.868270:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961606528:12345-192.168.202.16@tcp:41: Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596702.868275:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00080000:3.0:1789596702.868429:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596702.868433:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596702.871787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596702.871987:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606656 00000100:00100000:0.0:1789596702.871998:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606656 00000100:00100000:0.0:1789596702.872078:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789596702.872088:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961606656:12345-192.168.202.16@tcp:41: 00000004:00000024:0.0:1789596702.872121:0:8967:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789596702.872197:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961606656:12345-192.168.202.16@tcp:41: Request processed in 111us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596702.872204:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789596702.875328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596702.875451:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606784 00000100:00100000:3.0:1789596702.875463:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606784 00000100:00100000:3.0:1789596702.875519:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789596702.875530:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961606784:12345-192.168.202.16@tcp:40: 00000100:00100000:3.0:1789596702.875624:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961606784:12345-192.168.202.16@tcp:40: Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596702.875631:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789596702.889247:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596702.889294:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596702.889334:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596702.889430:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961606912 00000100:00100000:2.0:1789596702.889441:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961606912 00000100:00100000:2.0:1789596702.889485:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607040 00000100:00100000:2.0:1789596702.889488:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607040 00000100:00100000:2.0:1789596702.889512:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789596702.889521:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1876527961606912:12345-192.168.202.16@tcp:8: 00010000:00080000:2.0:1789596702.889554:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1789596702.889585:0:8436:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbe920 00002000:00100000:2.0:1789596702.889597:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2396ff16-3863-41e8-8748-2ac67b0298b6/ffff9c7d8318a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789596702.889615:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789596702.889840:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789596702.889875:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596702.889937:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961606912:12345-192.168.202.16@tcp:8: Request processed in 416us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596702.889945:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789596702.889961:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789596702.889966:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1876527961607040:12345-192.168.202.16@tcp:8: 00010000:00080000:2.0:1789596702.889981:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1789596702.889995:0:8436:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbe927 00002000:00100000:2.0:1789596702.890000:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2396ff16-3863-41e8-8748-2ac67b0298b6/ffff9c7d8318f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789596702.890025:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789596702.890123:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789596702.890139:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596702.890161:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961607040:12345-192.168.202.16@tcp:8: Request processed in 193us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596702.890167:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789596702.891094:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607168 00000100:00100000:3.0:1789596702.891103:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607168 00000100:00100000:3.0:1789596702.891152:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789596702.891160:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961607168:12345-192.168.202.16@tcp:900: 00000100:00100000:3.0:1789596702.891218:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961607168:12345-192.168.202.16@tcp:900: Request processed in 59us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596702.891225:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789596702.893861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596702.894081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607296 00000100:00100000:2.0:1789596702.894093:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607296 00000100:00100000:2.0:1789596702.894155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:2.0:1789596702.894169:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961607296:12345-192.168.202.16@tcp:400: 00000100:00100000:2.0:1789596702.894266:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961607296:12345-192.168.202.16@tcp:400: Request processed in 94us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596702.894273:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:1.0:1789596702.895755:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596702.896295:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607424 00000100:00100000:3.0:1789596702.896305:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607424 00000100:00100000:3.0:1789596702.896364:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789596702.896375:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961607424:12345-192.168.202.16@tcp:33: 00000004:00080000:3.0:1789596702.939223:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42750us 00000004:00200000:2.0:1789596702.966987:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789596702.967238:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6166:x1876527961607424:12345-192.168.202.16@tcp:33: Request processed in 70858us (71576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596702.967594:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00010000:00010000:0.0:1789596703.165539:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596703.278210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596703.279087:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607552 00000100:00100000:1.0:1789596703.279102:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607552 00000100:00100000:1.0:1789596703.279176:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1789596703.279188:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6208:x1876527961607552:12345-192.168.202.16@tcp:101: 00010000:00010000:1.0:1789596703.279210:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596703.279311:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbe92e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077d9 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596703.279387:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbe935 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596703.279404:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbe935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596703.279420:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbe935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596703.279470:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789596703.279474:0:8967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596703.279491:0:8967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbe935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596703.279518:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbe92e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077d9 expref: 8 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596703.279540:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbe935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077d9 expref: 7 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596703.279548:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a7fc00) 00010000:00010000:1.0:1789596703.279551:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596703.279555:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671c00, rc 0) 00000100:00100000:1.0:1789596703.279632:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:6208:x1876527961607552:12345-192.168.202.16@tcp:101: Request processed in 445us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596703.279639:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00010000:00010000:2.0:1789596704.191243:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596704.704218:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596704.704248:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984725888:0@lo:41: 00000100:00100000:3.0:1789596704.704358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596704.704417:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984725888 00000100:00100000:1.0:1789596704.704443:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984725888 00000100:00100000:1.0:1789596704.704620:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789596704.704632:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984725888:12345-0@lo:41: 00000004:00000024:1.0:1789596704.704671:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789596704.704760:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984725888:12345-0@lo:41: Request processed in 131us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596704.704768:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789596704.704815:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984725888:0@lo:41: 00010000:00010000:1.0:1789596705.214192:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596705.697656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596705.697816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607680 00000100:00100000:3.0:1789596705.697844:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607680 00000100:00080000:2.0:1789596705.697910:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596705.697932:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789596705.697943:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:6261:x1876527961607680:12345-192.168.202.16@tcp:41: 00000004:00000024:3.0:1789596705.697982:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789596705.698061:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:6261:x1876527961607680:12345-192.168.202.16@tcp:41: Request processed in 119us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596705.698069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789596705.714031:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596705.714508:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607808 00000100:00100000:1.0:1789596705.714520:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607808 00000100:00100000:1.0:1789596705.714652:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789596705.714664:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6261:x1876527961607808:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1789596705.714751:0:8967:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596705.714849:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6261:x1876527961607808:12345-192.168.202.16@tcp:41: Request processed in 186us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596705.714857:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:2.0:1789596705.717621:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596705.724150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596705.724418:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961607936 00000100:00100000:2.0:1789596705.724431:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961607936 00000100:00100000:2.0:1789596705.724576:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789596705.724588:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6261:x1876527961607936:12345-192.168.202.16@tcp:13: 00002000:00000024:2.0:1789596705.724631:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596705.724745:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6261:x1876527961607936:12345-192.168.202.16@tcp:13: Request processed in 159us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596705.724754:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789596705.725723:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984726016:0@lo:13: 00000100:00100000:1.0:1789596705.725792:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596705.725939:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726016 00000100:00100000:0.0:1789596705.725947:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726016 00000100:00080000:3.0:1789596705.726670:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596705.726834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596705.726850:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984726144:0@lo:13: 00000100:00100000:2.0:1789596705.726907:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596705.727012:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726144 00000100:00100000:1.0:1789596705.727018:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726144 00000100:00100000:1.0:1789596705.727078:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596705.727088:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984726144:12345-0@lo:13: 00002000:00000024:1.0:1789596705.727109:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789596705.727200:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596705.727770:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984726144:12345-0@lo:13: Request processed in 680us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596705.727786:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596705.727864:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596705.727874:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984726016:12345-0@lo:13: 00002000:00000024:1.0:1789596705.727890:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596705.728509:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984726016:12345-0@lo:13: Request processed in 634us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596705.728517:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789596705.729492:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d82798700 x1876527984726016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596705.729517:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984726016:0@lo:13: 00000100:00100000:1.0:1789596705.729655:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596705.729891:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608064 00000100:00100000:0.0:1789596705.729900:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608064 00000100:00100000:0.0:1789596705.729974:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789596705.729986:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6261:x1876527961608064:12345-192.168.202.16@tcp:13: 00002000:00000024:0.0:1789596705.730022:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596705.730404:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2396ff16-3863-41e8-8748-2ac67b0298b6+6:6261:x1876527961608064:12345-192.168.202.16@tcp:13: Request processed in 419us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596705.730413:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00080000:3.0:1789596705.733139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789596705.733506:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6300 x1876527984726144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596705.733535:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984726144:0@lo:13: 00010000:00010000:0.0:1789596706.236991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596706.237208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984726272:0@lo:13: 00000100:00100000:0.0:1789596706.237316:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.237482:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596706.237492:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984726400:0@lo:13: 00000100:00100000:3.0:1789596706.237522:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596706.237606:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726272 00000100:00100000:0.0:1789596706.237621:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726272 00000100:00100000:0.0:1789596706.237712:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726400 00000100:00100000:0.0:1789596706.237717:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726400 00000100:00100000:0.0:1789596706.237739:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596706.237747:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984726272:12345-0@lo:13: 00002000:00000024:0.0:1789596706.237770:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596706.237815:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984726272:12345-0@lo:13: Request processed in 68us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596706.237822:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596706.237840:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596706.237846:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984726400:12345-0@lo:13: 00002000:00000024:0.0:1789596706.237856:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596706.237881:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984726400:12345-0@lo:13: Request processed in 35us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596706.237887:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789596706.237924:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6300 x1876527984726272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596706.237942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984726272:0@lo:13: 00000100:00080000:3.0:1789596706.238013:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789596706.238036:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5500 x1876527984726400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596706.238049:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984726400:0@lo:13: 00000100:00100000:3.0:1789596706.238370:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984726656:0@lo:400: 00000100:00100000:3.0:1789596706.238403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.238432:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984727168:0@lo:400: 00000100:00100000:3.0:1789596706.238453:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.238468:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984727680:0@lo:400: 00000100:00100000:3.0:1789596706.238487:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.238518:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789596706.238525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984726784:0@lo:400: 00000100:00100000:3.0:1789596706.238548:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.238562:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984727296:0@lo:400: 00000100:00100000:3.0:1789596706.238580:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.238596:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984727808:0@lo:400: 00000100:00100000:3.0:1789596706.238612:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.238631:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726656 00000100:00100000:3.0:1789596706.238636:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726656 00000100:00100000:3.0:1789596706.238660:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727168 00000100:00100000:3.0:1789596706.238662:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727168 00000100:00100000:3.0:1789596706.238712:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727680 00000100:00100000:3.0:1789596706.238715:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727680 00000100:00100000:3.0:1789596706.238730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727296 00000100:00100000:3.0:1789596706.238732:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727296 00000100:00100000:3.0:1789596706.238743:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727808 00000100:00100000:3.0:1789596706.238745:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727808 00000100:00100000:3.0:1789596706.238758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789596706.238765:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984726656:12345-0@lo:400: 00000100:00100000:3.0:1789596706.238807:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984726656:12345-0@lo:400: Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596706.238813:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789596706.238827:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789596706.238832:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984727168:12345-0@lo:400: 00000100:00100000:3.0:1789596706.238856:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984727168:12345-0@lo:400: Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596706.238861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789596706.238871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789596706.238876:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984727680:12345-0@lo:400: 00000100:00100000:3.0:1789596706.238908:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984727680:12345-0@lo:400: Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596706.238914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789596706.238926:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789596706.238931:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984727296:12345-0@lo:400: 00000100:00100000:3.0:1789596706.238954:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984727296:12345-0@lo:400: Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596706.238959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789596706.238969:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789596706.238975:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984727808:12345-0@lo:400: 00000100:00100000:3.0:1789596706.238999:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984727808:12345-0@lo:400: Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596706.239004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789596706.239019:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596706.239021:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789596706.239041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d4700 x1876527984727296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596706.239052:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984727296:0@lo:400: 00010000:00080000:3.0:1789596706.239061:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d4000 x1876527984727808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596706.239070:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984727808:0@lo:400: 00000100:00100000:3.0:1789596706.239079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984726656:0@lo:400: 00000100:00100000:3.0:1789596706.239086:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984727168:0@lo:400: 00000100:00100000:3.0:1789596706.239094:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984727680:0@lo:400: 00000100:00100000:3.0:1789596706.239127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984726528:0@lo:400: 00000100:00100000:3.0:1789596706.239154:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.239173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984727040:0@lo:400: 00000100:00100000:3.0:1789596706.239190:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.239203:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984727552:0@lo:400: 00000100:00100000:3.0:1789596706.239221:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.239250:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789596706.239255:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984726912:0@lo:400: 00000100:00100000:3.0:1789596706.239272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.239284:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984727424:0@lo:400: 00000100:00100000:3.0:1789596706.239312:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596706.239335:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726784 00000100:00100000:3.0:1789596706.239338:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726784 00000100:00100000:3.0:1789596706.239358:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727040 00000100:00100000:3.0:1789596706.239359:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727040 00000100:00100000:3.0:1789596706.239370:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789596706.239375:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984726784:12345-0@lo:400: 00000100:00100000:3.0:1789596706.239405:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984726784:12345-0@lo:400: Request processed in 30us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596706.239410:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789596706.239420:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789596706.239424:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984727040:12345-0@lo:400: 00000100:00100000:3.0:1789596706.239446:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984727040:12345-0@lo:400: Request processed in 22us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596706.239627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726912 00000100:00100000:0.0:1789596706.239631:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726912 00000100:00100000:0.0:1789596706.239652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789596706.239658:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984726912:12345-0@lo:400: 00000100:00100000:0.0:1789596706.239715:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984726912:12345-0@lo:400: Request processed in 58us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596706.239721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789596706.239756:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984726784:0@lo:400: 00000100:00100000:1.0:1789596706.239899:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984726528 00000100:00100000:1.0:1789596706.239903:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984726528 00000100:00100000:1.0:1789596706.239939:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789596706.239945:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984726528:12345-0@lo:400: 00000100:00100000:1.0:1789596706.239978:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984726528:12345-0@lo:400: Request processed in 34us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596706.239984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789596706.240010:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727552 00000100:00100000:1.0:1789596706.240013:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727552 00000100:00100000:1.0:1789596706.240034:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727424 00000100:00100000:1.0:1789596706.240036:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727424 00000100:00100000:1.0:1789596706.240052:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596706.240057:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984727552:12345-0@lo:400: 00000100:00100000:1.0:1789596706.240083:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984727552:12345-0@lo:400: Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596706.240088:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596706.240097:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596706.240102:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984727424:12345-0@lo:400: 00000100:00100000:1.0:1789596706.240135:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984727424:12345-0@lo:400: Request processed in 34us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596706.240141:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596706.240178:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984726912:0@lo:400: 00010000:00080000:1.0:1789596706.240188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d6d80 x1876527984727424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596706.240197:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984727424:0@lo:400: 00000100:00100000:1.0:1789596706.240204:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984726528:0@lo:400: 00000100:00100000:1.0:1789596706.240212:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984727040:0@lo:400: 00010000:00080000:1.0:1789596706.240220:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d6a00 x1876527984727552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596706.240241:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984727552:0@lo:400: 00000100:00100000:3.0:1789596706.241894:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:3.0:1789596707.261880:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789596707.264396:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000001:00100000:3.0:1789596707.264967:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000001:00100000:1.0:1789596707.265145:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000100:00100000:3.0:1789596707.774453:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596707.774482:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984727936:0@lo:41: 00000100:00100000:3.0:1789596707.774553:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596707.775081:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984727936 00000100:00100000:2.0:1789596707.775090:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984727936 00000100:00100000:2.0:1789596707.775155:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789596707.775165:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984727936:12345-0@lo:41: 00000004:00000024:2.0:1789596707.775197:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596707.775294:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984727936:12345-0@lo:41: Request processed in 130us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596707.775301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789596707.775581:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984727936:0@lo:41: 00010000:00010000:1.0:1789596708.284942:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596708.344340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596708.344410:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596708.344437:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596708.344461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596708.344485:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596708.344515:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608448 00000100:00100000:0.0:1789596708.344525:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608448 00000100:00100000:3.0:1789596708.344827:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608192 00000100:00100000:3.0:1789596708.344833:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608192 00000100:00100000:3.0:1789596708.344868:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:3.0:1789596708.344892:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2406:x1876527961608192:12345-192.168.202.16@tcp:400: 00000100:00100000:3.0:1789596708.344959:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2406:x1876527961608192:12345-192.168.202.16@tcp:400: Request processed in 83us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596708.344967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00080000:3.0:1789596708.344997:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596708.345964:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608320 00000100:00100000:0.0:1789596708.345987:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608320 00000100:00100000:0.0:1789596708.346036:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789596708.346045:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961608448:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789596708.346101:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961608448:12345-192.168.202.16@tcp:400: Request processed in 57us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596708.346107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789596708.346123:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1789596708.346129:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961608320:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789596708.346154:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961608320:12345-192.168.202.16@tcp:400: Request processed in 25us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596708.347002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1789596708.347041:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608704 00000100:00100000:0.0:1789596708.347047:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608704 00000100:00100000:0.0:1789596708.347084:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608576 00000100:00100000:0.0:1789596708.347087:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608576 00000100:00100000:0.0:1789596708.347111:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789596708.347118:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961608704:12345-192.168.202.16@tcp:400: 00000100:00080000:3.0:1789596708.347622:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789596708.347627:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596708.347630:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596708.347997:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1789596708.348009:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961608576:12345-192.168.202.16@tcp:400: 00000100:00100000:3.0:1789596708.348053:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961608576:12345-192.168.202.16@tcp:400: Request processed in 48us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596708.348060:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789596708.348436:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961608704:12345-192.168.202.16@tcp:400: Request processed in 43us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596708.348444:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000001:02000400:2.0:1789596708.603537:0:10185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789596709.311766:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789596709.312383:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000100:00100000:1.0:1789596709.823822:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596709.823858:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984728064:0@lo:41: 00000100:00100000:1.0:1789596709.823968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596709.824131:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728064 00000100:00100000:2.0:1789596709.824142:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728064 00000100:00100000:2.0:1789596709.824209:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789596709.824221:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984728064:12345-0@lo:41: 00000004:00000024:2.0:1789596709.824265:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789596709.824332:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984728064:12345-0@lo:41: Request processed in 112us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596709.824339:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789596709.824383:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984728064:0@lo:41: 00010000:00010000:3.0:1789596710.333820:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596710.845809:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984728192:0@lo:13: 00000100:00100000:2.0:1789596710.845939:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596710.846061:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596710.846076:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984728320:0@lo:13: 00000100:00100000:2.0:1789596710.846127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596710.846247:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728192 00000100:00100000:2.0:1789596710.846256:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728192 00000100:00100000:2.0:1789596710.846353:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728320 00000100:00100000:2.0:1789596710.846358:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728320 00000100:00080000:3.0:1789596710.846484:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596710.847168:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596710.847189:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984728192:12345-0@lo:13: 00002000:00000024:2.0:1789596710.847232:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596710.847333:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984728192:12345-0@lo:13: Request processed in 149us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596710.847346:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596710.847474:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596710.847613:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984728320:12345-0@lo:13: 00002000:00000024:2.0:1789596710.847630:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596710.847721:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984728320:12345-0@lo:13: Request processed in 236us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596710.847734:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789596710.847828:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d82798e00 x1876527984728320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596710.847859:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984728320:0@lo:13: 00010000:00080000:2.0:1789596710.847888:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d7b80 x1876527984728192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596710.847913:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984728192:0@lo:13: 00000100:00100000:2.0:1789596711.357148:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984728448:0@lo:13: 00000100:00100000:2.0:1789596711.357266:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.357667:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984728832:0@lo:400: 00000100:00100000:3.0:1789596711.357831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984728576:0@lo:400: 00000100:00100000:2.0:1789596711.357898:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984728960:0@lo:400: 00000100:00100000:1.0:1789596711.357946:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728448 00000100:00100000:1.0:1789596711.357959:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728448 00000100:00100000:1.0:1789596711.358065:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789596711.358079:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984728448:12345-0@lo:13: 00002000:00000024:1.0:1789596711.358126:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596711.358471:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358501:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984729344:0@lo:400: 00000100:00100000:0.0:1789596711.358528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984729856:0@lo:400: 00000100:00100000:0.0:1789596711.358568:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358600:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789596711.358606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984728704:0@lo:400: 00000100:00100000:0.0:1789596711.358639:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358667:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984729216:0@lo:400: 00000100:00100000:0.0:1789596711.358707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358734:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984729728:0@lo:400: 00000100:00100000:0.0:1789596711.358755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358791:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728832 00000100:00100000:0.0:1789596711.358799:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728832 00000100:00100000:0.0:1789596711.358844:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596711.358853:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984728832:12345-0@lo:400: 00000100:00100000:0.0:1789596711.358913:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984728832:12345-0@lo:400: Request processed in 59us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.358921:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596711.358948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729344 00000100:00100000:0.0:1789596711.358954:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729344 00000100:00100000:3.0:1789596711.358967:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.358983:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729856 00000100:00100000:0.0:1789596711.358989:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729856 00000100:00100000:0.0:1789596711.359007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728704 00000100:00100000:0.0:1789596711.359010:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728704 00000100:00100000:0.0:1789596711.359035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729216 00000100:00100000:0.0:1789596711.359038:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729216 00000100:00100000:0.0:1789596711.359051:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729728 00000100:00100000:0.0:1789596711.359053:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729728 00000100:00100000:0.0:1789596711.359066:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789596711.359075:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984729344:12345-0@lo:400: 00000100:00100000:3.0:1789596711.359108:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984729088:0@lo:400: 00000100:00100000:0.0:1789596711.359125:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984729344:12345-0@lo:400: Request processed in 48us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.359133:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789596711.359152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789596711.359162:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.359169:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984729856:12345-0@lo:400: 00000100:00100000:3.0:1789596711.359216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984729600:0@lo:400: 00000100:00100000:0.0:1789596711.359224:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984729856:12345-0@lo:400: Request processed in 56us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.359231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789596711.359257:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596711.359266:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596711.359277:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984728704:12345-0@lo:400: 00000100:00100000:0.0:1789596711.359672:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984728704:12345-0@lo:400: Request processed in 395us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.359703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596711.359720:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596711.359728:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984729216:12345-0@lo:400: 00000100:00100000:0.0:1789596711.359758:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984729216:12345-0@lo:400: Request processed in 33us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.359764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596711.359776:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596711.359783:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984729728:12345-0@lo:400: 00000100:00100000:0.0:1789596711.359809:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984729728:12345-0@lo:400: Request processed in 27us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.359822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596711.359858:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729088 00000100:00100000:0.0:1789596711.359864:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729088 00000100:00100000:0.0:1789596711.359908:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596711.359921:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984729088:12345-0@lo:400: 00000100:00100000:0.0:1789596711.359985:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984729088:12345-0@lo:400: Request processed in 67us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.359991:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596711.360042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984728704:0@lo:400: 00000100:00100000:0.0:1789596711.360057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984729216:0@lo:400: 00000100:00080000:3.0:1789596711.360060:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596711.360069:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596711.360073:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984729728:0@lo:400: 00000100:00080000:3.0:1789596711.360075:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596711.360094:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984728832:0@lo:400: 00010000:00080000:0.0:1789596711.360112:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb179880 x1876527984729344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596711.360119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728576 00000100:00100000:0.0:1789596711.360126:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984729344:0@lo:400: 00000100:00100000:3.0:1789596711.360130:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728576 00010000:00080000:0.0:1789596711.360143:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb179180 x1876527984729856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596711.360156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984729856:0@lo:400: 00000100:00100000:3.0:1789596711.360191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789596711.360203:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984728576:12345-0@lo:400: 00000100:00100000:3.0:1789596711.360264:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984728576:12345-0@lo:400: Request processed in 64us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596711.360271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789596711.360631:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596711.360703:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984729472:0@lo:400: 00000100:00100000:2.0:1789596711.360736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596711.360760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984729984:0@lo:400: 00000100:00100000:2.0:1789596711.360782:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596711.360804:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596711.360810:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984730112:0@lo:13: 00000100:00100000:2.0:1789596711.360831:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596711.360864:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729600 00000100:00100000:2.0:1789596711.360870:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729600 00000100:00100000:2.0:1789596711.360900:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729472 00000100:00100000:2.0:1789596711.360903:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729472 00000100:00100000:2.0:1789596711.360913:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984729984 00000100:00100000:2.0:1789596711.360916:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984729984 00010000:00010000:0.0:1789596711.361092:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596711.361106:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596711.361116:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984729600:12345-0@lo:400: 00000100:00100000:0.0:1789596711.361159:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984729600:12345-0@lo:400: Request processed in 46us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.361176:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596711.361190:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596711.361196:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984729472:12345-0@lo:400: 00000100:00100000:0.0:1789596711.361230:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984729472:12345-0@lo:400: Request processed in 34us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.361236:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596711.361290:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789596711.362779:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984728576:0@lo:400: 00000100:00100000:3.0:1789596711.362806:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984729088:0@lo:400: 00010000:00080000:3.0:1789596711.362822:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb17bb80 x1876527984729600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596711.362833:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984729600:0@lo:400: 00010000:00080000:3.0:1789596711.362910:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb178700 x1876527984729472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596711.362920:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984729472:0@lo:400: 00000100:00100000:3.0:1789596711.362964:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984728960 00000100:00100000:3.0:1789596711.362973:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984728960 00000100:00100000:3.0:1789596711.363047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596711.363057:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984728960:12345-0@lo:400: 00000100:00100000:3.0:1789596711.363164:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984728960:12345-0@lo:400: Request processed in 108us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596711.363191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789596711.363320:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984728960:0@lo:400: 00000100:00100000:0.0:1789596711.364769:0:8439:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789596711.364870:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984728448:12345-0@lo:13: Request processed in 6792us (7600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.364883:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596711.364917:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984730112 00000100:00100000:0.0:1789596711.364926:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984730112 00000100:00100000:0.0:1789596711.364961:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596711.364969:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876527984730112:12345-0@lo:13: 00002000:00000024:0.0:1789596711.364993:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596711.365982:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876527984730112:12345-0@lo:13: Request processed in 1009us (5145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596711.365991:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789596711.366210:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb210700 x1876527984730112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596711.366242:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984730112:0@lo:13: 00010000:00080000:3.0:1789596711.366267:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b6680 x1876527984728448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596711.366280:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984728448:0@lo:13: 00000100:00100000:2.0:1789596711.370445:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596711.370462:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984729984:12345-0@lo:400: 00000100:00100000:2.0:1789596711.370571:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984729984:12345-0@lo:400: Request processed in 113us (9787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596711.370578:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789596711.371028:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596711.371821:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb178e00 x1876527984729984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596711.371844:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984729984:0@lo:400: 00000020:00000080:1.0:1789596712.317229:0:10334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8473d0c0 20000000:00000080:1.0:1789596712.317245:0:10334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7eb9abf000 uarg=0000000000000000 20000000:01000000:1.0:1789596712.317302:0:10334:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789596712.317305:0:10334:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789596712.317308:0:10334:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789596712.317313:0:10334:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789596712.317318:0:10334:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789596712.317386:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789596712.317389:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789596712.318291:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789596712.318543:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789596712.318573:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789596712.318589:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1789596712.318602:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789596712.318605:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789596712.319014:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789596712.319169:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789596712.319191:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789596712.319207:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789596712.319217:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789596712.319218:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789596712.319473:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789596712.319779:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789596712.319805:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789596712.319835:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1789596712.319844:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789596712.319847:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789596712.320360:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789596712.320493:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789596712.320529:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789596712.320544:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789596712.320554:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789596712.320556:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789596712.321041:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789596712.321187:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789596712.321207:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789596712.321232:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:0.0:1789596712.321246:0:10334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789596712.321265:0:10334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321284:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321292:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321299:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321305:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321313:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321319:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321326:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321333:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321340:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321360:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321367:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321374:0:10334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321414:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321431:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 9 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.321446:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb179180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730240:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596712.321569:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321578:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.321586:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb179880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730368:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596712.321616:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.321624:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 23 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322046:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730496:0@lo:104: 00000100:00100000:0.0:1789596712.322085:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596712.322122:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322131:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 23 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322140:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730624:0@lo:104: 00000100:00100000:0.0:1789596712.322160:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596712.322181:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322189:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 23 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322197:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730752:0@lo:104: 00000100:00100000:0.0:1789596712.322217:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596712.322234:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322242:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322249:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb178e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730880:0@lo:104: 00000100:00100000:0.0:1789596712.322272:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596712.322287:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322307:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 23 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322315:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb178700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731008:0@lo:104: 00010000:00010000:0.0:1789596712.322340:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322347:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 23 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322354:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731136:0@lo:104: 00010000:00010000:0.0:1789596712.322390:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322397:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322404:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb179500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731264:0@lo:104: 00010000:00010000:0.0:1789596712.322423:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322431:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322439:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731392:0@lo:104: 00010000:00010000:0.0:1789596712.322460:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.322479:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.322487:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731520:0@lo:104: 00000100:00100000:0.0:1789596712.322517:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789596712.322596:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789596712.322615:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.322627:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.322635:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.322655:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.322665:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.322674:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984730496 00000100:00100000:1.0:1789596712.322706:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984730496 00000100:00100000:1.0:1789596712.322743:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984730624 00000100:00100000:1.0:1789596712.322746:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984730624 00000100:00100000:1.0:1789596712.322756:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984730752 00000100:00100000:1.0:1789596712.322759:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984730752 00000100:00100000:1.0:1789596712.322768:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984730880 00000100:00100000:1.0:1789596712.322769:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984730880 00000100:00100000:1.0:1789596712.322778:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731008 00000100:00100000:1.0:1789596712.322780:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731008 00000100:00100000:1.0:1789596712.322789:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731136 00000100:00100000:1.0:1789596712.322791:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731136 00000100:00100000:1.0:1789596712.322800:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731264 00000100:00100000:1.0:1789596712.322803:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731264 00000100:00100000:1.0:1789596712.322934:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731392 00000100:00100000:1.0:1789596712.322937:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731392 00000100:00100000:1.0:1789596712.322947:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731520 00000100:00100000:1.0:1789596712.322949:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731520 00000100:00100000:1.0:1789596712.322961:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789596712.322970:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+11:10334:x1876527984730496:12345-0@lo:104: 00010000:00010000:1.0:1789596712.322982:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323039:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596712.323044:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+11:10334:x1876527984730496:12345-0@lo:104: Request processed in 77us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323050:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789596712.323074:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789596712.323079:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+10:10334:x1876527984730624:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323087:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323116:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789596712.323121:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+10:10334:x1876527984730624:12345-0@lo:104: Request processed in 42us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323126:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789596712.323137:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596712.323143:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+9:10334:x1876527984730752:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323149:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323180:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789596712.323185:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+9:10334:x1876527984730752:12345-0@lo:104: Request processed in 43us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323191:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596712.323203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789596712.323208:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb020850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+8:10334:x1876527984730880:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323214:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323241:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789596712.323245:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb020850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+8:10334:x1876527984730880:12345-0@lo:104: Request processed in 38us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323251:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789596712.323290:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789596712.323296:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+7:10334:x1876527984731008:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323305:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323331:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789596712.323335:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+7:10334:x1876527984731008:12345-0@lo:104: Request processed in 40us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323340:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789596712.323350:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789596712.323356:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+6:10334:x1876527984731136:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323362:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323386:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789596712.323391:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+6:10334:x1876527984731136:12345-0@lo:104: Request processed in 36us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323395:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789596712.323405:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789596712.323410:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+5:10334:x1876527984731264:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323416:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323440:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789596712.323445:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+5:10334:x1876527984731264:12345-0@lo:104: Request processed in 35us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323449:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789596712.323467:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789596712.323473:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:10334:x1876527984731392:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323480:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323507:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1789596712.323512:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:10334:x1876527984731392:12345-0@lo:104: Request processed in 39us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323517:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789596712.323526:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789596712.323530:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:10334:x1876527984731520:12345-0@lo:104: 00010000:00010000:1.0:1789596712.323536:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323559:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1789596712.323563:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:10334:x1876527984731520:12345-0@lo:104: Request processed in 33us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.323568:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789596712.323586:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1789596712.323592:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323600:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.323603:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.323611:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.323629:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.323635:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596712.323995:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1789596712.324003:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.324010:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596712.324014:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.324022:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596712.324029:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596712.324035:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789596712.324121:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730496:0@lo:104: 00000100:00100000:0.0:1789596712.324131:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730624:0@lo:104: 00000100:00100000:0.0:1789596712.324139:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730752:0@lo:104: 00000100:00100000:0.0:1789596712.324146:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb178e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730880:0@lo:104: 00000100:00100000:0.0:1789596712.324153:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb178700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731008:0@lo:104: 00000100:00100000:0.0:1789596712.324160:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731136:0@lo:104: 00000100:00100000:0.0:1789596712.324166:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb179500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731264:0@lo:104: 00000100:00100000:0.0:1789596712.324173:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731392:0@lo:104: 00000100:00100000:0.0:1789596712.324181:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984731520:0@lo:104: 00010000:00010000:1.0:1789596712.324265:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324273:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.324293:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324300:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbe8e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324315:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789596712.324318:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324324:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.324327:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324334:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.324339:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.324344:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596712.324469:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.324476:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596712.324482:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.324488:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbe8b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324577:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324584:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.324610:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324617:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbe89b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe8a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324626:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789596712.324628:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324633:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.324636:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324642:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.324659:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.324664:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596712.324693:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324699:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.324705:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324721:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031600/0x7b5398e289bbe871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe878 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324731:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789596712.324734:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324739:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.324742:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324748:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.324754:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.324758:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596712.324772:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324776:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.324781:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324787:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6200/0x7b5398e289bbe855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe85c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.324794:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789596712.324802:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596712.324902:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984731904:0@lo:103: 00000100:00100000:2.0:1789596712.324951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596712.324993:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596712.325000:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984732032:0@lo:103: 00000100:00100000:2.0:1789596712.325022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596712.325050:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731904 00000100:00100000:2.0:1789596712.325055:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731904 00010000:00010000:2.0:1789596712.325080:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 24 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596712.325103:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732032 00000100:00100000:2.0:1789596712.325113:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732032 00010000:00010000:2.0:1789596712.325128:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 25 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596712.325149:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596712.325157:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e9184b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+25:3644:x1876527984731904:12345-0@lo:103: 00010000:00010000:2.0:1789596712.325168:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596712.325173:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 25 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596712.325184:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 25 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596712.325199:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6c00/0x7b5398e289bbe8a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe89b expref: 25 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596712.325211:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596712.325241:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e9184b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984731904:12345-0@lo:103: Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596712.325247:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596712.325287:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596712.325293:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+23:3644:x1876527984732032:12345-0@lo:103: 00010000:00010000:2.0:1789596712.325299:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596712.325304:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596712.325312:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596712.325322:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7a00/0x7b5398e289bbe878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe871 expref: 23 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596712.325337:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596712.325360:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+22:3644:x1876527984732032:12345-0@lo:103: Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596712.325365:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596712.325397:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984732032:0@lo:103: 00000100:00100000:2.0:1789596712.325405:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984731904:0@lo:103: 00010000:00010000:1.0:1789596712.325574:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.325578:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325585:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.325591:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.325596:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596712.325614:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325620:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.325626:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325632:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bbe847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe84e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325654:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789596712.325659:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325665:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.325669:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325921:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.325927:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.325933:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596712.325948:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.325953:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789596712.325989:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984732416:0@lo:103: 00000100:00100000:2.0:1789596712.326018:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596712.326191:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596712.326196:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.326203:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596712.326206:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.326213:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596712.326220:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596712.326225:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596712.326240:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.326246:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.326273:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326281:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe840 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326291:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596712.326294:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326300:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596712.326303:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326309:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596712.326314:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596712.326326:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596712.326340:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326345:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596712.326350:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326356:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bbe7d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe7d7 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326366:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596712.326367:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596712.326369:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596712.326377:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596712.326386:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984731648:0@lo:103: 00000100:00100000:1.0:1789596712.326412:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.326431:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984732160:0@lo:103: 00000100:00100000:1.0:1789596712.326449:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.326458:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984732672:0@lo:103: 00000100:00100000:1.0:1789596712.326472:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.326483:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789596712.326488:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984731776:0@lo:103: 00000100:00100000:1.0:1789596712.326516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.326525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984732288:0@lo:103: 00000100:00100000:1.0:1789596712.326543:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596712.326575:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732416 00000100:00100000:1.0:1789596712.326580:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732416 00010000:00010000:1.0:1789596712.326600:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 22 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.326615:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731648 00000100:00100000:1.0:1789596712.326618:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731648 00010000:00010000:1.0:1789596712.326626:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 23 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.326634:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732160 00000100:00100000:1.0:1789596712.326637:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732160 00010000:00010000:1.0:1789596712.326661:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 24 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.326670:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732672 00000100:00100000:1.0:1789596712.326673:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732672 00010000:00010000:1.0:1789596712.326703:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 25 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.326713:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984731776 00000100:00100000:1.0:1789596712.326715:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984731776 00010000:00010000:1.0:1789596712.326725:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 26 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.326734:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732288 00000100:00100000:1.0:1789596712.326736:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732288 00010000:00010000:1.0:1789596712.326744:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 27 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.326756:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596712.326762:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+27:3644:x1876527984732416:12345-0@lo:103: 00010000:00010000:1.0:1789596712.326771:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596712.326781:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 27 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326790:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 27 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326802:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe839 expref: 27 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.326824:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596712.327135:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327155:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bbe7fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe801 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327170:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596712.327172:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596712.327174:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596712.327187:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789596712.327195:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+26:3646:x1876527984731648:12345-0@lo:103: 00010000:00010000:3.0:1789596712.327203:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596712.327208:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 26 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327217:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 26 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327227:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbe8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe8e1 expref: 26 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327235:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596712.327279:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+25:3646:x1876527984731648:12345-0@lo:103: Request processed in 85us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596712.327286:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789596712.327302:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789596712.327309:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984732160:12345-0@lo:103: 00010000:00010000:3.0:1789596712.327318:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596712.327322:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 24 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327339:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 24 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327348:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe85c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe855 expref: 24 pid: 6513 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327357:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596712.327380:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984732160:12345-0@lo:103: Request processed in 72us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596712.327385:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789596712.327397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789596712.327403:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+22:3646:x1876527984732672:12345-0@lo:103: 00010000:00010000:3.0:1789596712.327409:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596712.327414:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 22 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327421:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 22 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327430:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe7d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe7d0 expref: 22 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327439:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596712.327458:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+21:3646:x1876527984732672:12345-0@lo:103: Request processed in 56us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596712.327464:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789596712.327475:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596712.327480:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+20:3646:x1876527984731776:12345-0@lo:103: 00010000:00010000:3.0:1789596712.327493:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596712.327509:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 20 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327518:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 20 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327528:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe8be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe8b7 expref: 20 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327536:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596712.327561:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+19:3646:x1876527984731776:12345-0@lo:103: Request processed in 80us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596712.327567:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596712.327581:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596712.327587:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e91849850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+18:3646:x1876527984732288:12345-0@lo:103: 00010000:00010000:3.0:1789596712.327594:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596712.327598:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 18 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327605:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 18 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327615:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe84e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe847 expref: 18 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.327623:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596712.327658:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e91849850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+17:3646:x1876527984732288:12345-0@lo:103: Request processed in 56us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596712.327674:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596712.327983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984731776:0@lo:103: 00000100:00100000:0.0:1789596712.327994:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984732288:0@lo:103: 00000100:00100000:0.0:1789596712.328002:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984731648:0@lo:103: 00000100:00100000:0.0:1789596712.328007:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984732160:0@lo:103: 00000100:00100000:0.0:1789596712.328014:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984732672:0@lo:103: 00000100:00100000:0.0:1789596712.328062:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb179180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730240:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596712.328071:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb179880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876527984730368:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596712.328120:0:10334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596712.328469:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596712.328564:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608832 00000100:00100000:0.0:1789596712.328571:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608832 00010000:00010000:0.0:1789596712.328595:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 10 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596712.328614:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789596712.328621:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2409:x1876527961608832:12345-192.168.202.16@tcp:103: 00010000:00010000:0.0:1789596712.328630:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596712.328634:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 10 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.328658:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 10 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.328670:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030600/0x7b5398e289bbe8fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07770 expref: 10 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.328699:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596712.329297:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454a6744-d65e-403d-97e2-e8496b673d4c+9:2409:x1876527961608832:12345-192.168.202.16@tcp:103: Request processed in 672us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596712.329307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789596712.329411:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+16:3644:x1876527984732416:12345-0@lo:103: Request processed in 2647us (3391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.329428:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596712.330122:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984732544:0@lo:103: 00000100:00100000:3.0:1789596712.330180:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596712.330925:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732544 00000100:00100000:3.0:1789596712.330936:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732544 00010000:00010000:3.0:1789596712.330969:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 16 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596712.331005:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596712.331014:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+16:3645:x1876527984732544:12345-0@lo:103: 00010000:00010000:3.0:1789596712.331028:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596712.331033:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 16 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.331043:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 16 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.331059:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671e00/0x7b5398e289bbe801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe7fa expref: 16 pid: 6512 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596712.331074:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596712.331121:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+15:3645:x1876527984732544:12345-0@lo:103: Request processed in 108us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596712.331128:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596712.331165:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984732544:0@lo:103: 00000100:00100000:3.0:1789596712.332051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596712.332114:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961608960 00000100:00100000:1.0:1789596712.332120:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961608960 00010000:00010000:1.0:1789596712.332145:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596712.332182:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:1.0:1789596712.332191:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+9:2407:x1876527961608960:12345-192.168.202.16@tcp:103: 00010000:00010000:1.0:1789596712.332203:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596712.332208:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332218:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332230:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031a00/0x7b5398e289bbe8f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07769 expref: 9 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332260:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332269:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332285:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332293:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332299:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332306:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332312:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596712.332317:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332325:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332341:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596712.332352:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596712.332391:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+8:2407:x1876527961608960:12345-192.168.202.16@tcp:103: Request processed in 202us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596712.332404:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00010000:00010000:0.0:1789596712.333325:0:10334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.333339:0:10334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596712.333358:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6a00/0x7b5398e289bbe93c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596712.334992:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984732416:0@lo:103: 00010000:00010000:0.0:1789596712.381633:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596712.894634:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984732800:0@lo:41: 00000100:00100000:1.0:1789596712.894740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596712.894852:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732800 00000100:00100000:0.0:1789596712.894861:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732800 00000100:00100000:0.0:1789596712.894919:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596712.894928:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984732800:12345-0@lo:41: 00000004:00000024:0.0:1789596712.894963:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596712.896756:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984732800:12345-0@lo:41: Request processed in 1816us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596712.896769:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789596712.899624:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984732800:0@lo:41: 00010000:00010000:1.0:1789596713.405050:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596713.469828:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596713.469901:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596713.469945:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596713.469968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596713.470005:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596713.470029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609344 00000100:00100000:3.0:1789596713.470039:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609600 00000100:00100000:2.0:1789596713.470041:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609344 00000100:00100000:3.0:1789596713.470046:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609600 00000100:00100000:2.0:1789596713.470177:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609216 00000100:00100000:2.0:1789596713.470182:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609216 00000100:00100000:0.0:1789596713.470182:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609472 00000100:00100000:0.0:1789596713.470190:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609472 00000100:00100000:1.0:1789596713.470251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609088 00000100:00100000:1.0:1789596713.470258:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609088 00000100:00100000:1.0:1789596713.470293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:1.0:1789596713.470305:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+8:2406:x1876527961609088:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1789596713.470398:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+8:2406:x1876527961609088:12345-192.168.202.16@tcp:400: Request processed in 94us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596713.470408:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:1.0:1789596713.470459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789596713.470467:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961609344:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1789596713.471161:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961609344:12345-192.168.202.16@tcp:400: Request processed in 692us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596713.471170:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:3.0:1789596713.472632:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789596713.472659:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961609600:12345-192.168.202.16@tcp:400: 00000100:00100000:3.0:1789596713.472743:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961609600:12345-192.168.202.16@tcp:400: Request processed in 85us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596713.472751:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789596713.478482:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:2.0:1789596713.478500:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961609216:12345-192.168.202.16@tcp:400: 00000100:00100000:2.0:1789596713.479393:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961609216:12345-192.168.202.16@tcp:400: Request processed in 894us (9418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596713.479403:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789596713.481591:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789596713.481609:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961609472:12345-192.168.202.16@tcp:400: 00000100:00080000:1.0:1789596713.481762:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596713.481768:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596713.481771:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596713.481774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596713.484773:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961609472:12345-192.168.202.16@tcp:400: Request processed in 3157us (14753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596713.484790:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 10000000:01000000:0.0:1789596714.303769:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789596714.303779:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7ebb0f4000 from 48 10000000:01000000:0.0:1789596714.303784:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596714.303837:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.303850:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.303888:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.303915:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984732928:0@lo:101: 00000100:00100000:0.0:1789596714.303993:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.304075:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596714.305717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984732928 00000100:00100000:3.0:1789596714.305733:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984732928 00000100:00100000:3.0:1789596714.305805:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789596714.305816:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+15:6517:x1876527984732928:12345-0@lo:101: 00010000:00010000:3.0:1789596714.305831:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596714.305864:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da600/0x7b5398e289bbe94a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe943 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.305891:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da600/0x7b5398e289bbe94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe943 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.305902:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da600/0x7b5398e289bbe94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe943 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.305911:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da600, rc 0) 00000100:00100000:3.0:1789596714.305984:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984732928:12345-0@lo:101: Request processed in 170us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596714.306006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789596714.306164:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984732928:0@lo:101: 00010000:00010000:0.0:1789596714.306182:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.306191:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.306259:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733056:0@lo:501: 00000100:00100000:0.0:1789596714.306288:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.306323:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.306391:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733056 00000100:00100000:1.0:1789596714.306396:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733056 00000100:00100000:1.0:1789596714.306436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789596714.306443:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984733056:12345-0@lo:501: 00000100:00100000:1.0:1789596714.306575:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984733056:12345-0@lo:501: Request processed in 132us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.306582:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789596714.306666:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733056:0@lo:501: 00000100:00100000:0.0:1789596714.306721:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733184:0@lo:503: 00000100:00100000:0.0:1789596714.306761:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.306789:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.306829:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733184 00000100:00100000:2.0:1789596714.306835:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733184 00000100:00100000:2.0:1789596714.306861:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789596714.306868:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984733184:12345-0@lo:503: 00000100:00100000:2.0:1789596714.306979:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984733184:12345-0@lo:503: Request processed in 111us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.306995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789596714.307085:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733184:0@lo:503: 00000100:00100000:1.0:1789596714.307881:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10351:1876527984733312:0@lo:502: 00000100:00100000:1.0:1789596714.307925:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.307957:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96446d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.308053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733312 00000100:00100000:2.0:1789596714.308059:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733312 00000100:00100000:2.0:1789596714.308095:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789596714.308103:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:10351:x1876527984733312:12345-0@lo:502: 00000100:00100000:2.0:1789596714.308218:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+16:10351:x1876527984733312:12345-0@lo:502: Request processed in 116us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.308226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789596714.308312:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10351:1876527984733312:0@lo:502: 00000100:00100000:3.0:1789596714.308349:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10351:1876527984733440:0@lo:502: 00000100:00100000:3.0:1789596714.308377:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596714.308400:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.308476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733440 00000100:00100000:2.0:1789596714.308481:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733440 00000100:00100000:2.0:1789596714.308508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789596714.308514:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:10351:x1876527984733440:12345-0@lo:502: 00000100:00100000:2.0:1789596714.308579:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:10351:x1876527984733440:12345-0@lo:502: Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.308585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789596714.308663:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10351:1876527984733440:0@lo:502: 00000040:00080000:0.0:1789596714.308714:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789596714.308954:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789596714.308973:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789596714.308982:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.308993:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596714.309003:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789596714.309006:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789596714.309009:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789596714.309032:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.309046:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.309056:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596714.309068:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733568:0@lo:101: 00000100:00100000:2.0:1789596714.309097:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.309125:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596714.309173:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733568 00000100:00100000:3.0:1789596714.309177:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733568 00000100:00100000:3.0:1789596714.309208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789596714.309214:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+16:6517:x1876527984733568:12345-0@lo:101: 00010000:00010000:3.0:1789596714.309222:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596714.309232:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dae00/0x7b5398e289bbe958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe951 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.309253:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dae00/0x7b5398e289bbe958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe951 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.309262:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dae00/0x7b5398e289bbe958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe951 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.309270:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dae00, rc 0) 00000100:00100000:3.0:1789596714.309307:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984733568:12345-0@lo:101: Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596714.309313:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789596714.309377:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733568:0@lo:101: 00010000:00010000:0.0:1789596714.309394:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.309402:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.309448:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733696:0@lo:501: 00000100:00100000:0.0:1789596714.309476:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.309500:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.309544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733696 00000100:00100000:2.0:1789596714.309548:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733696 00000100:00100000:2.0:1789596714.309567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789596714.309573:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984733696:12345-0@lo:501: 00000100:00100000:2.0:1789596714.309716:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984733696:12345-0@lo:501: Request processed in 142us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.309722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789596714.309818:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733696:0@lo:501: 00000100:00100000:0.0:1789596714.309856:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733824:0@lo:503: 00000100:00100000:0.0:1789596714.309892:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.309908:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.310039:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733824 00000100:00100000:1.0:1789596714.310043:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733824 00000100:00100000:1.0:1789596714.310063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789596714.310069:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984733824:12345-0@lo:503: 00000100:00100000:1.0:1789596714.310142:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984733824:12345-0@lo:503: Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.310148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789596714.310827:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984733824:0@lo:503: 00000100:00100000:0.0:1789596714.311215:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10352:1876527984733952:0@lo:502: 00000100:00100000:0.0:1789596714.311260:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.311281:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.312668:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984733952 00000100:00100000:1.0:1789596714.312719:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984733952 00000100:00100000:1.0:1789596714.312782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789596714.312790:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:10352:x1876527984733952:12345-0@lo:502: 00000100:00100000:1.0:1789596714.312955:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:10352:x1876527984733952:12345-0@lo:502: Request processed in 165us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.312962:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789596714.313325:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10352:1876527984733952:0@lo:502: 00000020:01000000:0.0:1789596714.313366:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596714.313378:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596714.313380:0:10352:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789596714.313386:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789596714.313419:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10352:1876527984734080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.313461:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.313498:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.313548:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734080 00000100:00100000:2.0:1789596714.313553:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734080 00000100:00100000:2.0:1789596714.313584:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789596714.313591:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:10352:x1876527984734080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.313702:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+17:10352:x1876527984734080:12345-0@lo:502:llog_process_th.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.313709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789596714.314177:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10352:1876527984734080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596714.314205:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596714.314210:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596714.314212:0:10352:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789596714.314217:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789596714.315788:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789596714.315821:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789596714.315834:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.315871:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596714.315882:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789596714.315884:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7ebaf79000 from 48 10000000:01000000:2.0:1789596714.315887:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596714.315925:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.315933:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.315944:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596714.315966:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.316026:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.316063:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.316146:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734208 00000100:00100000:1.0:1789596714.316153:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734208 00000100:00100000:1.0:1789596714.316204:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789596714.316212:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+17:6517:x1876527984734208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596714.316225:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596714.316238:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe95f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.316269:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe95f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.316279:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe95f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.316288:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670000, rc 0) 00000100:00100000:1.0:1789596714.316326:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984734208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.316333:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789596714.316816:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596714.316832:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.316841:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596714.316912:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.316942:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.316967:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.317442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734336 00000100:00100000:1.0:1789596714.317447:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734336 00000100:00100000:1.0:1789596714.317484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789596714.317490:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984734336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.317608:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984734336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.317615:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789596714.317854:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.317887:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.317927:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.317959:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.318075:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734464 00000100:00100000:0.0:1789596714.318081:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734464 00000100:00100000:0.0:1789596714.318112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789596714.318120:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984734464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.318213:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984734464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.318220:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789596714.318607:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.319159:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10353:1876527984734592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.319202:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.319233:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.319278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734592 00000100:00100000:0.0:1789596714.319284:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734592 00000100:00100000:0.0:1789596714.319320:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789596714.319328:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:10353:x1876527984734592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.319439:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+18:10353:x1876527984734592:12345-0@lo:502:llog_process_th.0 Request processed in 111us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.319446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789596714.319544:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10353:1876527984734592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596714.319584:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10353:1876527984734720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596714.319617:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596714.319658:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.319743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734720 00000100:00100000:1.0:1789596714.319747:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734720 00000100:00100000:1.0:1789596714.319779:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789596714.319786:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:10353:x1876527984734720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596714.319869:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+18:10353:x1876527984734720:12345-0@lo:502:llog_process_th.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.319875:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789596714.320083:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10353:1876527984734720:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789596714.320102:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789596714.320267:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789596714.320288:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596714.320303:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.320314:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596714.320323:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789596714.320326:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789596714.320328:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789596714.320352:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.320360:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.320368:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596714.320382:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.320408:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.320436:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.320493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734848 00000100:00100000:2.0:1789596714.320498:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734848 00000100:00100000:2.0:1789596714.320531:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789596714.320537:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+18:6517:x1876527984734848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596714.320546:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596714.320556:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbe974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe96d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.320576:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbe974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe96d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.320584:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbe974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe96d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.320591:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510a00, rc 0) 00000100:00100000:2.0:1789596714.320616:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984734848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.320622:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789596714.321161:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596714.321173:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.321183:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596714.321229:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.321264:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.321289:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.321375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984734976 00000100:00100000:2.0:1789596714.321380:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984734976 00000100:00100000:2.0:1789596714.321410:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789596714.321417:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984734976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.321514:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984734976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.321521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789596714.322317:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984734976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.322351:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.322396:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.322427:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.322479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735104 00000100:00100000:2.0:1789596714.322484:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735104 00000100:00100000:2.0:1789596714.322522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789596714.322530:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984735104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.322639:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984735104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.322647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789596714.323279:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.331562:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10354:1876527984735232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.332021:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.332064:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.332120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735232 00000100:00100000:1.0:1789596714.332128:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735232 00000100:00100000:1.0:1789596714.332182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789596714.332190:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+19:10354:x1876527984735232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596714.332309:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+19:10354:x1876527984735232:12345-0@lo:502:llog_process_th.0 Request processed in 119us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.332317:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789596714.332454:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10354:1876527984735232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596714.332480:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596714.332488:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596714.332490:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789596714.332494:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789596714.332512:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10354:1876527984735360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.332542:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.332563:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.332606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735360 00000100:00100000:0.0:1789596714.332611:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735360 00000100:00100000:0.0:1789596714.332650:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789596714.332656:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:10354:x1876527984735360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.332758:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:10354:x1876527984735360:12345-0@lo:502:llog_process_th.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.332765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789596714.333189:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10354:1876527984735360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596714.333221:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596714.333225:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596714.333227:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789596714.333232:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789596714.333464:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789596714.333485:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789596714.333495:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.333508:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596714.333518:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789596714.333520:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7eb9a66000 from 48 10000000:01000000:1.0:1789596714.333524:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596714.333550:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.333565:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.333575:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596714.333591:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.333623:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.333672:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.333839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735488 00000100:00100000:0.0:1789596714.333999:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735488 00000100:00100000:0.0:1789596714.334039:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789596714.334046:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:6517:x1876527984735488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596714.334057:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596714.334071:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7800/0x7b5398e289bbe982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe97b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.334092:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7800/0x7b5398e289bbe982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe97b expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.334102:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c7800/0x7b5398e289bbe982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe97b expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.334109:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c7800, rc 0) 00000100:00100000:0.0:1789596714.334163:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984735488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.334169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789596714.334440:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596714.334455:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.334464:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596714.334514:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.334538:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.334563:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.334597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735616 00000100:00100000:0.0:1789596714.334601:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735616 00000100:00100000:0.0:1789596714.334637:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789596714.334643:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984735616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.334771:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984735616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.334778:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789596714.334841:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.334874:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.334907:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.334936:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.335018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735744 00000100:00100000:0.0:1789596714.335022:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735744 00000100:00100000:0.0:1789596714.335037:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789596714.335042:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984735744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.335112:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984735744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.335123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789596714.336861:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984735744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.337439:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10355:1876527984735872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596714.337503:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.337543:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.337596:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984735872 00000100:00100000:0.0:1789596714.337602:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984735872 00000100:00100000:0.0:1789596714.337659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789596714.337702:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:10355:x1876527984735872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.337823:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:10355:x1876527984735872:12345-0@lo:502:llog_process_th.0 Request processed in 157us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.337830:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789596714.338082:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10355:1876527984735872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.338125:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10355:1876527984736000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.338172:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.338197:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.338288:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736000 00000100:00100000:0.0:1789596714.338292:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736000 00000100:00100000:0.0:1789596714.338311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789596714.338316:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:10355:x1876527984736000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.338391:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:10355:x1876527984736000:12345-0@lo:502:llog_process_th.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.338397:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789596714.338464:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10355:1876527984736000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789596714.338491:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789596714.338650:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789596714.338712:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596714.338723:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.338734:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596714.338744:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789596714.338747:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789596714.338751:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789596714.338774:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.338789:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.338798:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.338812:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.338841:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.338876:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.339081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736128 00000100:00100000:1.0:1789596714.339086:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736128 00000100:00100000:1.0:1789596714.339112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789596714.339118:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984736128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596714.339128:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596714.339142:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe989 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.339233:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe989 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.339243:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe989 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.339252:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670200, rc 0) 00000100:00100000:1.0:1789596714.339297:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984736128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.339303:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789596714.340816:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596714.340841:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.340870:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.341109:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.341226:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.341256:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.341414:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736256 00000100:00100000:1.0:1789596714.341421:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736256 00000100:00100000:1.0:1789596714.341466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789596714.341474:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984736256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.341603:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984736256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.341610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789596714.341818:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.341995:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.342042:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.342070:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.342112:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736384 00000100:00100000:2.0:1789596714.342117:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736384 00000100:00100000:2.0:1789596714.342142:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789596714.342160:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984736384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.342260:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984736384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.342267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789596714.342395:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.343643:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10356:1876527984736512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596714.343742:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.343772:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.344132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736512 00000100:00100000:2.0:1789596714.344140:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736512 00000100:00100000:2.0:1789596714.344189:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789596714.344198:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:10356:x1876527984736512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.344341:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:10356:x1876527984736512:12345-0@lo:502:llog_process_th.0 Request processed in 144us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.344349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789596714.344715:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10356:1876527984736512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596714.344746:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596714.344755:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596714.344758:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789596714.344764:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789596714.344788:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10356:1876527984736640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596714.344824:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596714.344849:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.344919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736640 00000100:00100000:0.0:1789596714.344929:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736640 00000100:00100000:0.0:1789596714.344957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789596714.344964:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:10356:x1876527984736640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.345045:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:10356:x1876527984736640:12345-0@lo:502:llog_process_th.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.345051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789596714.345179:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10356:1876527984736640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596714.345196:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596714.345200:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596714.345202:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789596714.345205:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789596714.345576:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789596714.345595:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789596714.345604:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.345615:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596714.345636:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789596714.345639:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e867d5800 from 48 10000000:01000000:0.0:1789596714.345643:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596714.345670:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.345709:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.345719:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.345734:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.345767:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.345791:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596714.345865:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736768 00000100:00100000:3.0:1789596714.345870:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736768 00000100:00100000:3.0:1789596714.345896:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789596714.345903:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984736768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596714.345928:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596714.345940:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe997 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.345960:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe997 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.345970:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe997 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.345984:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da200, rc 0) 00000100:00100000:3.0:1789596714.346023:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984736768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596714.346029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789596714.346274:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596714.346288:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.346296:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.346343:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.346367:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.346388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984736896 00000100:00100000:0.0:1789596714.346392:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984736896 00000100:00100000:0.0:1789596714.346409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789596714.346415:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984736896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.346513:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984736896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.346519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789596714.346538:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.346548:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984736896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.346572:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.346608:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.346642:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737024 00000100:00100000:0.0:1789596714.346646:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737024 00000100:00100000:0.0:1789596714.346663:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789596714.346668:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984737024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.346762:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984737024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.346779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789596714.346812:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.346825:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.348268:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10357:1876527984737152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596714.348332:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.348369:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.348421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737152 00000100:00100000:0.0:1789596714.348428:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737152 00000100:00100000:0.0:1789596714.348468:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789596714.348477:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:10357:x1876527984737152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.348586:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:10357:x1876527984737152:12345-0@lo:502:llog_process_th.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.348593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789596714.348890:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10357:1876527984737152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.349069:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10357:1876527984737280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596714.349106:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.349135:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.349231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737280 00000100:00100000:0.0:1789596714.349236:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737280 00000100:00100000:0.0:1789596714.349265:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789596714.349271:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:10357:x1876527984737280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.349348:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:10357:x1876527984737280:12345-0@lo:502:llog_process_th.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.349355:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789596714.349426:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10357:1876527984737280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789596714.349447:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789596714.349709:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789596714.349727:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596714.349736:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.349747:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596714.349757:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789596714.349765:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789596714.349768:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596714.349791:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.349799:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.349809:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.349821:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.350097:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.350126:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.350229:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737408 00000100:00100000:1.0:1789596714.350233:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737408 00000100:00100000:1.0:1789596714.350272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789596714.350279:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984737408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596714.350288:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596714.350301:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe9ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe9a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.350337:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe9a5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.350348:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9a5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596714.350357:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670400, rc 0) 00000100:00100000:1.0:1789596714.350395:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984737408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.350401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789596714.350483:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596714.350497:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.350507:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596714.350584:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.350610:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.350643:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.350726:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737536 00000100:00100000:0.0:1789596714.350730:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737536 00000100:00100000:0.0:1789596714.350748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789596714.350753:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984737536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.351262:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984737536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.351270:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789596714.351414:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.351445:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.351484:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596714.351511:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928480 going to sleep for 11 seconds 00000100:00100000:1.0:1789596714.351547:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737664 00000100:00100000:1.0:1789596714.351552:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737664 00000100:00100000:1.0:1789596714.351584:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789596714.351591:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984737664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596714.352444:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984737664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 851us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596714.352453:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789596714.352556:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984737664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596714.353383:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10358:1876527984737792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596714.353436:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596714.353472:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.353525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737792 00000100:00100000:0.0:1789596714.353531:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737792 00000100:00100000:0.0:1789596714.353574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789596714.353583:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:10358:x1876527984737792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.353729:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:10358:x1876527984737792:12345-0@lo:502:llog_process_th.0 Request processed in 148us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.353736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789596714.354704:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10358:1876527984737792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596714.354737:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596714.354747:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596714.354749:0:10358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789596714.354755:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789596714.354781:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10358:1876527984737920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596714.354828:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596714.354874:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596714.355047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984737920 00000100:00100000:0.0:1789596714.355053:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984737920 00000100:00100000:0.0:1789596714.355096:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789596714.355105:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:10358:x1876527984737920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596714.355205:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:10358:x1876527984737920:12345-0@lo:502:llog_process_th.0 Request processed in 101us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596714.355211:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789596714.355338:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10358:1876527984737920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596714.355356:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596714.355360:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596714.355361:0:10358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789596714.355365:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789596714.355798:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789596714.355822:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789596714.355832:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.355854:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596714.355865:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789596714.355867:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7e88948000 from 1 10000000:01000000:0.0:1789596714.355869:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789596714.355892:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.355901:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596714.355920:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596714.355935:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984738048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596714.355965:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596714.356003:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.356101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738048 00000100:00100000:2.0:1789596714.356106:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738048 00000100:00100000:2.0:1789596714.356139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789596714.356146:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984738048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596714.356165:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596714.356178:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe9ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe9b3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.356199:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe9b3 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.356208:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9b3 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.356217:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510800, rc 0) 00000100:00100000:2.0:1789596714.356258:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984738048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.356274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789596714.356387:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984738048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596714.356399:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.356407:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596714.356463:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984738176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596714.356489:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596714.356511:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596714.356761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738176 00000100:00100000:2.0:1789596714.356766:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738176 00000100:00100000:2.0:1789596714.356797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789596714.356804:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984738176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596714.356883:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984738176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (392us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596714.356890:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789596714.356927:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984738176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789596714.356948:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789596714.356953:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596714.356961:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596714.429033:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596714.941047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984738304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596714.941132:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596714.941608:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738304 00000100:00100000:1.0:1789596714.941631:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738304 00000100:00100000:1.0:1789596714.941952:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789596714.941967:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984738304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596714.942016:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596714.942097:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984738304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596714.942185:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984738304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596714.946849:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596715.194280:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596715.195000:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609728 00000100:00100000:2.0:1789596715.195012:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609728 00000100:00100000:2.0:1789596715.195074:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:2.0:1789596715.195085:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+8:6180:x1876527961609728:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1789596715.195103:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596715.195123:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe9c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596715.195169:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077e0 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596715.195182:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077e0 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596715.195190:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510200, rc 0) 00000100:00100000:2.0:1789596715.195259:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961609728:12345-192.168.202.16@tcp:101: Request processed in 176us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.195266:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:3.0:1789596715.208039:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596715.208158:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609856 00000100:00100000:0.0:1789596715.208172:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609856 00000100:00100000:0.0:1789596715.208238:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:0.0:1789596715.208249:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961609856:12345-192.168.202.16@tcp:501: 00000100:00100000:0.0:1789596715.208424:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961609856:12345-192.168.202.16@tcp:501: Request processed in 176us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596715.208432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:1.0:1789596715.216843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596715.217047:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961609984 00000100:00100000:3.0:1789596715.217062:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961609984 00000100:00100000:3.0:1789596715.217149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:3.0:1789596715.217162:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961609984:12345-192.168.202.16@tcp:503: 00000100:00100000:3.0:1789596715.217380:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961609984:12345-192.168.202.16@tcp:503: Request processed in 221us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596715.217388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:3.0:1789596715.222630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596715.231538:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610112 00000100:00100000:2.0:1789596715.231560:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610112 00000100:00100000:2.0:1789596715.231672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:2.0:1789596715.231854:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+9:6667:x1876527961610112:12345-192.168.202.16@tcp:502: 00000100:00100000:2.0:1789596715.232091:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+9:6667:x1876527961610112:12345-192.168.202.16@tcp:502: Request processed in 242us (9484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.232100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:1.0:1789596715.237925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596715.238015:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610240 00000100:00100000:0.0:1789596715.238030:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610240 00000100:00100000:0.0:1789596715.238116:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:0.0:1789596715.238129:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+9:6667:x1876527961610240:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789596715.238661:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+9:6667:x1876527961610240:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 532us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596715.238671:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:1.0:1789596715.258878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596715.259210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610368 00000100:00100000:3.0:1789596715.259224:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610368 00000100:00100000:3.0:1789596715.259314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:3.0:1789596715.259327:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961610368:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596715.259350:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596715.259376:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bbe9c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077e7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596715.259417:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bbe9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077e7 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596715.259430:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bbe9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077e7 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596715.259463:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db200, rc 0) 00000100:00100000:3.0:1789596715.259543:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961610368:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 219us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596715.259552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:3.0:1789596715.263154:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596715.263309:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610496 00000100:00100000:2.0:1789596715.263327:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610496 00000100:00100000:2.0:1789596715.263401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:2.0:1789596715.263414:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961610496:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596715.263585:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961610496:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 174us (457us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596715.263594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 251 00010000:00010000:0.0:1789596715.457809:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596715.968332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984738432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596715.969534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596715.970349:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984738560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596715.970419:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596715.970473:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738432 00000100:00100000:0.0:1789596715.970484:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738432 00000100:00100000:2.0:1789596715.970542:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738560 00000100:00100000:2.0:1789596715.970548:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738560 00000100:00100000:0.0:1789596715.970566:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596715.970590:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984738432:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596715.970720:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789596715.971001:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596715.971535:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984738432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 944us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.971544:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789596715.971571:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789596715.971580:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984738560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596715.971847:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596715.971906:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984738560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 328us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.971914:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789596715.971939:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d82798e00 x1876527984738560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596715.971964:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984738560:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789596715.972919:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212680 x1876527984738432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596715.972940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984738432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789596716.477134:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596716.477222:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596716.477252:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984738688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596716.477351:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.477491:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738688 00000100:00100000:3.0:1789596716.477515:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738688 00000100:00100000:3.0:1789596716.477662:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596716.477703:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984738688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596716.477751:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596716.477815:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984738688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596716.477823:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789596716.477881:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212680 x1876527984738688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596716.477904:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984738688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596716.479326:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596716.479419:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596716.479674:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738816 00000100:00100000:1.0:1789596716.479720:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738816 00000100:00100000:3.0:1789596716.480358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984739328:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.480447:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984739840:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480476:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.480514:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789596716.480520:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984738944:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.480591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984739456:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480627:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.480649:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984739968:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480672:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.480706:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984739200:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480717:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739328 00000100:00100000:3.0:1789596716.480722:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739328 00000100:00100000:0.0:1789596716.480741:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.480778:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984739712:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480780:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789596716.480789:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984739328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.480801:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.480818:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984740224:0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.480837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.480848:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984739328:12345-0@lo:400:kworker.0 Request processed in 61us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.480854:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789596716.480856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596716.480859:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984739072:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.480874:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739712 00000100:00100000:3.0:1789596716.480877:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739712 00000100:00100000:0.0:1789596716.480902:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.480918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984739584:0@lo:400:kworker.0 00000100:00080000:2.0:1789596716.480942:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596716.480949:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596716.480950:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.480961:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984740096:0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.480982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.481005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984738944 00000100:00100000:0.0:1789596716.481020:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984738944 00000100:00100000:0.0:1789596716.481065:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789596716.481073:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984738944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481118:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984738944:12345-0@lo:400:kworker.0 Request processed in 46us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481125:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789596716.481169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739456 00000100:00100000:0.0:1789596716.481173:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739456 00000100:00100000:0.0:1789596716.481191:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739200 00000100:00100000:0.0:1789596716.481194:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739200 00000100:00100000:0.0:1789596716.481207:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789596716.481213:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984739456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481263:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984739456:12345-0@lo:400:kworker.0 Request processed in 49us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789596716.481282:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596716.481288:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984739200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481321:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984739200:12345-0@lo:400:kworker.0 Request processed in 33us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481326:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596716.481349:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740224 00000100:00100000:0.0:1789596716.481353:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740224 00000100:00100000:0.0:1789596716.481394:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739072 00000100:00100000:0.0:1789596716.481397:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739072 00000100:00100000:0.0:1789596716.481407:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739584 00000100:00100000:0.0:1789596716.481409:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739584 00000100:00100000:0.0:1789596716.481432:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740096 00000100:00100000:0.0:1789596716.481434:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740096 00000100:00100000:0.0:1789596716.481447:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789596716.481452:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984740224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481492:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984740224:12345-0@lo:400:kworker.0 Request processed in 38us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481497:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789596716.481508:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789596716.481513:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984739072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481539:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984739072:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481544:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789596716.481554:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789596716.481568:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984739584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481595:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984739584:12345-0@lo:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481601:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789596716.481623:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789596716.481630:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984740096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481656:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984740096:12345-0@lo:400:kworker.0 Request processed in 27us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.481663:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789596716.481703:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596716.481707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596716.481750:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984739072:0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481763:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984739584:0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984740096:0@lo:400:kworker.0 00000100:00100000:0.0:1789596716.481782:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984739200:0@lo:400:kworker.0 00010000:00080000:0.0:1789596716.481795:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f4700 x1876527984740224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596716.481805:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984740224:0@lo:400:kworker.0 00000100:00100000:1.0:1789596716.482140:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789596716.482151:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984738816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596716.482172:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596716.482219:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984738816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596716.482225:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596716.483346:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596716.483360:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984739712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.483451:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984739712:12345-0@lo:400:kworker.0 Request processed in 95us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596716.483459:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596716.483490:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739840 00000100:00100000:3.0:1789596716.483516:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739840 00010000:00080000:1.0:1789596716.483781:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f6d80 x1876527984739712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596716.483798:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984739712:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.484806:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984739968 00000100:00100000:3.0:1789596716.484819:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984739968 00000100:00100000:3.0:1789596716.484866:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789596716.484875:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984739840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.484967:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984739840:12345-0@lo:400:kworker.0 Request processed in 93us (4489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596716.484975:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789596716.484991:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789596716.484998:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984739968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.485025:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984739968:12345-0@lo:400:kworker.0 Request processed in 28us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596716.485031:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789596716.485099:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984738944:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.485116:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984739456:0@lo:400:kworker.0 00010000:00080000:3.0:1789596716.485131:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f7100 x1876527984739968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596716.485142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984739968:0@lo:400:kworker.0 00000100:00100000:3.0:1789596716.485157:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984739328:0@lo:400:kworker.0 00010000:00080000:3.0:1789596716.485168:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f5500 x1876527984739840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596716.485177:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984739840:0@lo:400:kworker.0 00010000:00080000:3.0:1789596716.485190:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5180 x1876527984738816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596716.485229:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984738816:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1789596716.672748:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddfd33cf0 20000000:00000080:0.0:1789596716.672768:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7d83c81800 uarg=0000000000000000 20000000:01000000:0.0:1789596716.672814:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789596716.672820:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789596716.672826:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789596716.677295:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789596716.677567:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789596716.685268:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789596716.685311:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789596716.685327:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789596716.685343:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789596716.685364:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685501:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685510:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685517:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685525:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685535:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685542:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685595:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685621:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 9 pid: 6512 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.685638:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740352:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596716.685807:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685817:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 23 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.685826:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740480:0@lo:104: 00000100:00100000:0.0:1789596716.685873:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596716.685925:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685934:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.685942:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740608:0@lo:104: 00000100:00100000:0.0:1789596716.685967:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596716.685986:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.685993:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.686001:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740736:0@lo:104: 00000100:00100000:2.0:1789596716.686297:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789596716.686314:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740480 00000100:00100000:2.0:1789596716.686322:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740480 00000100:00100000:2.0:1789596716.686364:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740608 00000100:00100000:2.0:1789596716.686368:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740608 00000100:00100000:2.0:1789596716.686398:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789596716.686407:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:10395:x1876527984740480:12345-0@lo:104: 00010000:00010000:2.0:1789596716.686420:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.689708:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596716.689738:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:10395:x1876527984740480:12345-0@lo:104: Request processed in 3327us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596716.689751:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789596716.689789:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789596716.689802:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:10395:x1876527984740608:12345-0@lo:104: 00010000:00010000:2.0:1789596716.689834:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.689898:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596716.689903:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:10395:x1876527984740608:12345-0@lo:104: Request processed in 107us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596716.689910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789596716.689953:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596716.689960:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.689968:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596716.689973:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.689982:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596716.689989:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596716.689994:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596716.690043:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690061:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596716.690086:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690094:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81671200/0x7b5398e289bbe7ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe7f3 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690106:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596716.690109:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690115:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbe00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596716.690118:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690125:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596716.690131:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596716.690137:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596716.690151:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690158:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596716.690163:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690169:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbe00/0x7b5398e289bbe6c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe6cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690185:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596716.690186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596716.690188:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596716.690194:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596716.690216:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984740864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596716.690257:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596716.690294:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596716.690300:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984740992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596716.690322:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596716.690352:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740864 00000100:00100000:2.0:1789596716.690359:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740864 00010000:00010000:2.0:1789596716.690384:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 24 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596716.690406:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740992 00000100:00100000:2.0:1789596716.690409:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740992 00010000:00010000:2.0:1789596716.690421:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 25 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596716.690441:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789596716.690447:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+25:3644:x1876527984740864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596716.690456:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596716.690461:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 25 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690470:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 25 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690498:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596716.690528:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+25:3644:x1876527984740864:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596716.690535:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789596716.690548:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789596716.690555:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984740992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596716.690562:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596716.690566:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 24 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690575:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 24 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596716.690585:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596716.690620:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984740992:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596716.690626:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789596716.690665:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984740992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596716.690676:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984740864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596716.693135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596716.693396:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596716.693488:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.693504:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.693534:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984741120:0@lo:104: 00000100:00100000:0.0:1789596716.693566:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596716.693592:0:10395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596716.693624:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740352:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596716.693637:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98daa00/0x7b5398e289bbe7f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe7ec expref: 23 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.693649:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740480:0@lo:104: 00010000:00010000:0.0:1789596716.693657:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbe6cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe6c6 expref: 22 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.693665:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740608:0@lo:104: 00000100:00100000:0.0:1789596716.693734:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984740736 00000100:00100000:0.0:1789596716.693741:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984740736 00000100:00100000:0.0:1789596716.693785:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741120 00000100:00100000:0.0:1789596716.693788:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741120 00000100:00100000:0.0:1789596716.693803:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596716.693811:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:10395:x1876527984740736:12345-0@lo:104: 00010000:00010000:0.0:1789596716.693824:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.693871:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596716.693877:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:10395:x1876527984740736:12345-0@lo:104: Request processed in 67us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.693883:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596716.694084:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789596716.694091:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:10395:x1876527984741120:12345-0@lo:104: 00010000:00010000:0.0:1789596716.694105:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.694200:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789596716.694206:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:10395:x1876527984741120:12345-0@lo:104: Request processed in 115us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.694211:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789596716.694230:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610624 00000100:00100000:0.0:1789596716.694234:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610624 00010000:00010000:0.0:1789596716.694249:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 10 pid: 6512 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596716.694268:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789596716.694273:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+10:2408:x1876527961610624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596716.694282:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596716.694287:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 10 pid: 6512 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.694298:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 10 pid: 6512 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.694313:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671a00/0x7b5398e289bbe90b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a8 expref: 10 pid: 6512 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.694324:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596716.694359:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+9:2408:x1876527961610624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 85us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596716.694365:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789596716.694402:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984740736:0@lo:104: 00000100:00100000:0.0:1789596716.694410:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876527984741120:0@lo:104: 00010000:00010000:0.0:1789596716.694435:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.694763:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596716.694772:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.694781:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596716.694785:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.694793:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596716.694800:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596716.694806:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596716.694839:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.694845:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596716.694866:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.694872:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbe672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.694881:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789596716.694987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984741248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596716.695038:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596716.695248:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695269:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596716.695272:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695279:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596716.695285:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596716.695290:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596716.695315:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695322:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596716.695343:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695350:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe664 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe66b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695362:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596716.695364:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596716.695366:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596716.695379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596716.695387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984741376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596716.695413:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596716.695440:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741248 00000100:00100000:3.0:1789596716.695445:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741248 00010000:00010000:3.0:1789596716.695473:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 22 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596716.695493:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741376 00000100:00100000:3.0:1789596716.695497:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741376 00010000:00010000:3.0:1789596716.695509:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596716.695522:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596716.695528:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e9184bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984741248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596716.695539:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596716.695544:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695554:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695567:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbe679 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe672 expref: 23 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695779:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596716.695820:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e9184bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+22:3646:x1876527984741248:12345-0@lo:103:ldlm_bl.0 Request processed in 292us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596716.695827:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596716.695864:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789596716.695870:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+21:3646:x1876527984741376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596716.695877:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596716.695882:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 21 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695972:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 21 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695983:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbe66b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe664 expref: 21 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.695994:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696003:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696082:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696091:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696098:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696104:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696110:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596716.696114:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.696122:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596716.696263:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984741248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596716.696797:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596716.697998:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596716.698073:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.698444:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.698456:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596716.698474:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596716.698616:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d576172c-8178-43f9-add9-c496dd76058d+20:3646:x1876527984741376:12345-0@lo:103:ldlm_bl.0 Request processed in 2732us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596716.698626:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789596716.703005:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984741376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596717.501312:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596717.822363:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596717.822476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610752 00000100:00100000:0.0:1789596717.822490:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610752 00000100:00100000:0.0:1789596717.822567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:0.0:1789596717.822580:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+9:6180:x1876527961610752:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.822611:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596717.822636:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.822675:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.822719:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.822857:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c6800, rc 0) 00000100:00100000:0.0:1789596717.823216:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961610752:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 636us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.823225:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:0.0:1789596717.832811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596717.832908:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961610880 00000100:00100000:1.0:1789596717.832931:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961610880 00000100:00100000:1.0:1789596717.833006:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:1.0:1789596717.833019:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961610880:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596717.833240:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961610880:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 223us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596717.833274:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:0.0:1789596717.836032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596717.836234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611008 00000100:00100000:3.0:1789596717.836250:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611008 00000100:00100000:3.0:1789596717.836325:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:3.0:1789596717.836338:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961611008:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596717.836560:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6180:x1876527961611008:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 224us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596717.836570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:3.0:1789596717.843018:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596717.843669:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611136 00000100:00100000:0.0:1789596717.843867:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611136 00000100:00100000:3.0:1789596717.844035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:3.0:1789596717.844052:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6724:x1876527961611136:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596717.844296:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:6724:x1876527961611136:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 249us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596717.844305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:0.0:1789596717.849034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596717.849251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611264 00000100:00100000:1.0:1789596717.849266:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611264 00000100:00100000:1.0:1789596717.849339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 257 00000100:00100000:1.0:1789596717.849352:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6724:x1876527961611264:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596717.849581:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:6724:x1876527961611264:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 232us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596717.849590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 257 10000000:01000000:2.0:1789596717.884879:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596717.884892:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebb0f4000 from 4 10000000:01000000:2.0:1789596717.884900:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596717.884970:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596717.884986:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596717.885019:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596717.885055:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984741504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596717.885167:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596717.885238:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.885506:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741504 00000100:00100000:0.0:1789596717.885518:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741504 00000100:00100000:0.0:1789596717.885607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789596717.885633:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984741504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.885654:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596717.885709:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe9dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.885746:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.885761:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.885772:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c7c00, rc 0) 00000100:00100000:0.0:1789596717.885830:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984741504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.885838:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789596717.885997:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984741504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596717.886016:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596717.886026:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596717.886151:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984741632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596717.886183:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596717.886217:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596717.886234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741632 00000100:00100000:2.0:1789596717.886238:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741632 00000100:00100000:2.0:1789596717.886267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789596717.886273:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984741632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596717.886648:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984741632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596717.886657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789596717.893342:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984741632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596717.893483:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984741760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596717.893602:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596717.896782:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.899806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741760 00000100:00100000:0.0:1789596717.899831:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741760 00000100:00100000:0.0:1789596717.900004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789596717.900018:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984741760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.900280:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984741760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (6687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.900300:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789596717.900447:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984741760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596717.900825:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10428:1876527984741888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596717.900886:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596717.906393:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1789596717.906607:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984741888 00000100:00100000:1.0:1789596717.906629:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984741888 00000100:00100000:1.0:1789596717.906718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789596717.906731:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:10428:x1876527984741888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596717.906944:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:10428:x1876527984741888:12345-0@lo:502:llog_process_th.0 Request processed in 215us (6058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596717.906952:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789596717.907300:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10428:1876527984741888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596717.907354:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596717.907379:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596717.907382:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789596717.907392:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7ebb0f4000 00000020:00000080:3.0:1789596717.907396:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789596717.907533:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10428:1876527984742016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596717.907605:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596717.907650:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1789596717.910455:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742016 00000100:00100000:1.0:1789596717.910481:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742016 00000100:00100000:1.0:1789596717.910562:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789596717.910576:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:10428:x1876527984742016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596717.910869:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:10428:x1876527984742016:12345-0@lo:502:llog_process_th.0 Request processed in 297us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596717.910878:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789596717.910962:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10428:1876527984742016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596717.911012:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596717.911029:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596717.911031:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789596717.911040:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789596717.911719:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789596717.911763:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596717.911780:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596717.911797:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596717.911811:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789596717.911815:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebaf79000 from 4 10000000:01000000:3.0:1789596717.911819:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596717.911879:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596717.911888:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596717.911899:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596717.911929:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596717.911991:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596717.912037:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.912575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742144 00000100:00100000:0.0:1789596717.912585:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742144 00000100:00100000:0.0:1789596717.912654:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789596717.912665:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984742144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.912698:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596717.912719:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe9eb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.912750:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.912764:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.912773:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c7600, rc 0) 00000100:00100000:0.0:1789596717.912831:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984742144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.912839:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789596717.912894:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.912913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.912923:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596717.913000:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.913039:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.913056:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.913069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742272 00000100:00100000:0.0:1789596717.913073:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742272 00000100:00100000:0.0:1789596717.913091:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789596717.913097:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984742272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.913245:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984742272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.913252:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789596717.913283:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.913313:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.913359:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.913513:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.913526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742400 00000100:00100000:0.0:1789596717.913530:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742400 00000100:00100000:0.0:1789596717.913548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789596717.913553:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984742400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.913648:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984742400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.913655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789596717.913722:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.914037:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10430:1876527984742528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.914073:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.914094:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742528 00000100:00100000:0.0:1789596717.914105:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742528 00000100:00100000:0.0:1789596717.914199:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789596717.914206:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:10430:x1876527984742528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.914283:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:10430:x1876527984742528:12345-0@lo:502:llog_process_th.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.914290:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789596717.914324:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.914336:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10430:1876527984742528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596717.914362:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596717.915244:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596717.915247:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789596717.915260:0:10430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7ebaf79000 00000020:00000080:0.0:1789596717.915264:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789596717.916272:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10430:1876527984742656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.916474:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.916540:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742656 00000100:00100000:0.0:1789596717.916549:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742656 00000100:00100000:0.0:1789596717.916619:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789596717.916629:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:10430:x1876527984742656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.916800:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:10430:x1876527984742656:12345-0@lo:502:llog_process_th.0 Request processed in 171us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.916809:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789596717.916869:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.916896:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10430:1876527984742656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596717.916938:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596717.916948:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596717.916957:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789596717.916964:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789596717.917046:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789596717.917067:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596717.917079:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.917094:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596717.917107:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789596717.917111:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb9a66000 from 4 10000000:01000000:0.0:1789596717.917114:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789596717.921858:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.921883:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.921898:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596717.921940:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.922042:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.922101:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.922248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742784 00000100:00100000:0.0:1789596717.922258:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742784 00000100:00100000:0.0:1789596717.922321:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789596717.922332:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984742784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.922349:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596717.929295:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbe9f9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.929346:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.929363:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.929386:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c6200, rc 0) 00000100:00100000:0.0:1789596717.929500:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984742784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7167us (7456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.929510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789596717.929651:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.929674:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.929702:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596717.929806:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.929846:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.929885:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596717.930731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984742912 00000100:00100000:2.0:1789596717.930745:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984742912 00000100:00100000:2.0:1789596717.930810:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789596717.930831:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984742912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596717.931033:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984742912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596717.931042:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789596717.931101:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984742912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596717.931250:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596717.936889:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596717.938288:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.943449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743040 00000100:00100000:0.0:1789596717.943475:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743040 00000100:00100000:0.0:1789596717.946275:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789596717.946304:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984743040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.946564:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984743040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (9686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.946581:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789596717.951629:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.951980:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10434:1876527984743168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.952086:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.953622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743168 00000100:00100000:0.0:1789596717.953642:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743168 00000100:00100000:0.0:1789596717.953730:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789596717.953743:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:10434:x1876527984743168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.953950:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:10434:x1876527984743168:12345-0@lo:502:llog_process_th.0 Request processed in 210us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.953959:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789596717.954032:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.954063:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10434:1876527984743168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596717.954106:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596717.957485:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596717.957496:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789596717.957520:0:10434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7eb9a66000 00000020:00000080:0.0:1789596717.957524:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789596717.957985:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10434:1876527984743296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.958090:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.958143:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743296 00000100:00100000:0.0:1789596717.958153:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743296 00000100:00100000:0.0:1789596717.958214:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789596717.958225:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:10434:x1876527984743296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.960230:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:10434:x1876527984743296:12345-0@lo:502:llog_process_th.0 Request processed in 1992us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.960258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789596717.960448:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.960490:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10434:1876527984743296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596717.960540:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596717.960551:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596717.960553:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789596717.960561:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789596717.960674:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789596717.960714:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596717.960728:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.960742:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596717.960755:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789596717.960758:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e867d5800 from 4 10000000:01000000:0.0:1789596717.960762:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789596717.960809:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.960817:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.960827:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596717.960850:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.960918:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.960952:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.960970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743424 00000100:00100000:0.0:1789596717.960977:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743424 00000100:00100000:0.0:1789596717.961015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789596717.961025:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984743424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.961042:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596717.961057:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbea07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.961089:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.961101:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.961110:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510e00, rc 0) 00000100:00100000:0.0:1789596717.964092:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984743424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3054us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.964108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789596717.966631:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596717.966671:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.966707:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596717.966808:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.966880:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.966936:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.966958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743552 00000100:00100000:0.0:1789596717.966966:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743552 00000100:00100000:0.0:1789596717.967007:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789596717.967017:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984743552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.967510:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984743552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 491us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.967519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789596717.967564:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.967609:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.967655:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.967700:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928000 going to sleep for 11 seconds 00000100:00100000:3.0:1789596717.968499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743680 00000100:00100000:3.0:1789596717.968509:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743680 00000100:00100000:3.0:1789596717.968562:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789596717.968571:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984743680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596717.968747:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984743680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596717.968755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789596717.968814:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984743680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596717.971803:0:10437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10437:1876527984743808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.971914:0:10437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596717.971969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743808 00000100:00100000:0.0:1789596717.971979:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743808 00000100:00100000:0.0:1789596717.972036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789596717.972047:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:10437:x1876527984743808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596717.972566:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:10437:x1876527984743808:12345-0@lo:502:llog_process_th.0 Request processed in 519us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596717.972575:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789596717.972782:0:10437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e853bef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596717.972816:0:10437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10437:1876527984743808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596717.972855:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596717.972868:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596717.972878:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789596717.972889:0:10437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7e867d5800 00000020:00000080:0.0:1789596717.972891:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789596717.975860:0:10437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10437:1876527984743936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596717.975974:0:10437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596717.976026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984743936 00000100:00100000:3.0:1789596717.976035:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984743936 00000100:00100000:3.0:1789596717.976097:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789596717.976108:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:10437:x1876527984743936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596717.977646:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:10437:x1876527984743936:12345-0@lo:502:llog_process_th.0 Request processed in 1530us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596717.977664:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789596717.977772:0:10437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789596717.977804:0:10437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:10437:1876527984743936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596717.977843:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596717.977854:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596717.977856:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789596717.977863:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789596717.978785:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789596717.978815:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596717.978830:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596717.978845:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596718.014487:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984744064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596718.014579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596718.014666:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744064 00000100:00100000:0.0:1789596718.014696:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744064 00000100:00100000:0.0:1789596718.014758:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596718.014769:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984744064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789596718.014818:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596718.014875:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984744064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596718.014882:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596718.014957:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984744064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789596718.524933:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596718.585888:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596718.587581:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596718.587651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596718.587756:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611776 00000100:00100000:2.0:1789596718.587771:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611776 00000100:00100000:2.0:1789596718.587861:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789596718.587874:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961611776:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596718.587980:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961611776:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 108us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596718.587989:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789596718.597960:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:1.0:1789596718.598873:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596718.602876:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611520 00000100:00100000:0.0:1789596718.602896:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611520 00000100:00100000:0.0:1789596718.602991:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611392 00000100:00100000:0.0:1789596718.602995:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611392 00000100:00100000:0.0:1789596718.603032:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:0.0:1789596718.603044:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961611520:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596718.603182:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961611520:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 139us (17309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596718.603191:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:0.0:1789596718.603214:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1789596718.603221:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961611392:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596718.603251:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961611392:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (15599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596718.603257:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1789596718.603288:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611648 00000100:00100000:0.0:1789596718.603293:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611648 00000100:00100000:0.0:1789596718.603325:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789596718.603332:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961611648:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596718.603359:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961611648:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (5413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596718.603364:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00080000:1.0:1789596718.603767:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596718.603774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596718.603776:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789596719.550060:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596720.061221:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596720.061252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984744192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596720.061350:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596720.061647:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744192 00000100:00100000:1.0:1789596720.061659:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744192 00000100:00100000:1.0:1789596720.061783:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789596720.061795:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984744192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596720.061844:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596720.061904:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984744192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596720.061911:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789596720.062162:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984744192:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789596720.573315:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596721.085116:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984744320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596721.085221:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596721.085411:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744320 00000100:00100000:3.0:1789596721.085423:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744320 00000100:00100000:3.0:1789596721.085499:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596721.085511:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984744320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596721.085550:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596721.085616:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984744320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596721.085625:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789596721.085708:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596721.085752:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f4000 x1876527984744320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596721.085775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984744320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596721.095020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596721.095052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984744448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596721.095162:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596721.095513:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744448 00000100:00100000:1.0:1789596721.095525:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744448 00000100:00100000:1.0:1789596721.095620:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789596721.095645:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984744448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596721.095704:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596721.095769:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984744448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596721.095777:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789596721.095831:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4700 x1876527984744448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596721.095855:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984744448:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789596721.096008:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789596721.597586:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596721.597763:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984744576:0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.598101:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596721.598172:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984745088:0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.598205:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596721.598231:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984745600:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.598411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984744704:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.598448:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.598469:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984745216:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.598488:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.598504:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984745728:0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.598613:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596721.598633:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984746112:0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.598653:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596721.598718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744576 00000100:00100000:0.0:1789596721.598727:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744576 00000100:00100000:0.0:1789596721.598787:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789596721.598797:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984744576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.598859:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984744576:12345-0@lo:400:kworker.0 Request processed in 62us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596721.598866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789596721.598903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745088 00000100:00100000:0.0:1789596721.598907:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745088 00000100:00100000:0.0:1789596721.598936:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789596721.598943:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984745088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.598979:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984745088:12345-0@lo:400:kworker.0 Request processed in 37us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596721.598985:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789596721.599003:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744704 00000100:00100000:0.0:1789596721.599007:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744704 00000100:00100000:0.0:1789596721.599029:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745216 00000100:00100000:0.0:1789596721.599032:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745216 00000100:00100000:0.0:1789596721.599061:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789596721.599067:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984744704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.599098:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984744704:12345-0@lo:400:kworker.0 Request processed in 32us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596721.599104:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789596721.599114:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789596721.599126:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984745216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.599174:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984745216:12345-0@lo:400:kworker.0 Request processed in 48us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596721.599180:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789596721.599208:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596721.599246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984744576:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984746240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596721.599439:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599475:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984744704:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599487:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984745216:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984744960:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599628:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599647:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984745472:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599667:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599703:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984745984:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599723:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599742:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789596721.599749:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984744832:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599770:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599789:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984745344:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599824:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984745856:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.599845:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596721.599867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745728 00000100:00100000:2.0:1789596721.599871:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745728 00000100:00100000:2.0:1789596721.599904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744960 00000100:00100000:2.0:1789596721.599907:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744960 00000100:00100000:2.0:1789596721.599919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745344 00000100:00100000:2.0:1789596721.599922:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745344 00000100:00100000:2.0:1789596721.599933:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745856 00000100:00100000:2.0:1789596721.599935:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745856 00000100:00100000:2.0:1789596721.599950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789596721.599956:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984745728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.600008:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984745728:12345-0@lo:400:kworker.0 Request processed in 52us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.600016:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789596721.600031:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789596721.600037:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984744960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.600067:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984744960:12345-0@lo:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.600073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789596721.600084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789596721.600090:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984745344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.600114:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984745344:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.600120:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789596721.600129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789596721.600135:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984745856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.600162:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984745856:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.600168:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789596721.600188:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745600 00000100:00100000:2.0:1789596721.600192:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745600 00000100:00100000:2.0:1789596721.600211:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746112 00000100:00100000:2.0:1789596721.600215:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746112 00000100:00100000:2.0:1789596721.600228:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745472 00000100:00100000:2.0:1789596721.600230:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745472 00000100:00100000:2.0:1789596721.600239:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984745984 00000100:00100000:2.0:1789596721.600242:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984745984 00000100:00100000:0.0:1789596721.601701:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984745088:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.601883:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596721.601921:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984745600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.602030:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984745600:12345-0@lo:400:kworker.0 Request processed in 116us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.602038:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596721.602060:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596721.602067:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984746112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.602101:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984746112:12345-0@lo:400:kworker.0 Request processed in 35us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.602108:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596721.602119:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789596721.602125:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984745472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.602154:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984745472:12345-0@lo:400:kworker.0 Request processed in 29us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.602161:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789596721.602173:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596721.602180:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984745984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.602209:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984745984:12345-0@lo:400:kworker.0 Request processed in 31us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.602215:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596721.602247:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746240 00010000:00080000:0.0:1789596721.602372:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8372bb80 x1876527984745600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596721.602386:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984745600:0@lo:400:kworker.0 00010000:00080000:0.0:1789596721.602398:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb211180 x1876527984746112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596721.602407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984746112:0@lo:400:kworker.0 00000100:00100000:0.0:1789596721.604711:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984746368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596721.604815:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596721.604956:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746368 00000100:00100000:2.0:1789596721.604969:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746240 00000100:00100000:1.0:1789596721.604969:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746368 00000100:00100000:1.0:1789596721.605037:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789596721.605042:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789596721.605047:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984746368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596721.605048:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984746240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789596721.605086:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789596721.605086:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596721.605135:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984746240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (5695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.605151:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789596721.605206:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596721.605213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596721.605217:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596721.605231:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984744832 00000100:00100000:2.0:1789596721.605236:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984744832 00000100:00100000:2.0:1789596721.605267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789596721.605269:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984746368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.605274:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984744832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596721.605275:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789596721.605314:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984744832:12345-0@lo:400:kworker.0 Request processed in 40us (5543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596721.605320:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789596721.605376:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984744832:0@lo:400:kworker.0 00010000:00080000:2.0:1789596721.605397:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8372a680 x1876527984745344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596721.605410:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984745344:0@lo:400:kworker.0 00010000:00080000:2.0:1789596721.605424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729880 x1876527984745856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596721.605433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984745856:0@lo:400:kworker.0 00000100:00100000:2.0:1789596721.605446:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984744960:0@lo:400:kworker.0 00010000:00080000:2.0:1789596721.605459:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8372aa00 x1876527984745472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596721.605467:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984745472:0@lo:400:kworker.0 00010000:00080000:2.0:1789596721.605479:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212300 x1876527984745984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596721.605496:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984745984:0@lo:400:kworker.0 00010000:00080000:0.0:1789596721.605887:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4700 x1876527984746368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596721.605907:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984746368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596721.606017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984745728:0@lo:400:kworker.0 00010000:00080000:2.0:1789596721.606029:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d826c1500 x1876527984746240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596721.606042:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984746240:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789596722.622307:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596723.133051:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984746496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596723.133119:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596723.133188:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746496 00000100:00100000:2.0:1789596723.133195:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746496 00000100:00100000:2.0:1789596723.133240:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789596723.133248:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984746496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596723.133279:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596723.133320:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984746496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596723.133326:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789596723.133439:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984746496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789596723.654988:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596723.703081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596723.703126:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596723.703154:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596723.703171:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596723.703187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596723.703369:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612416 00000100:00100000:3.0:1789596723.703378:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612416 00000100:00100000:3.0:1789596723.703420:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612288 00000100:00100000:3.0:1789596723.703422:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612288 00000100:00100000:1.0:1789596723.703587:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612160 00000100:00100000:1.0:1789596723.703594:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612160 00000100:00100000:1.0:1789596723.703626:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612032 00000100:00100000:1.0:1789596723.703629:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612032 00000100:00100000:1.0:1789596723.703654:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:1.0:1789596723.703664:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961612160:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596723.703752:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961612160:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 89us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596723.703760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:1.0:1789596723.703777:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:1.0:1789596723.703790:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961612032:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596723.703816:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961612032:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596723.703822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1789596723.703916:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789596723.703925:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961612416:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596723.704162:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961612416:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 237us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596723.704170:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789596723.704185:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789596723.704192:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961612288:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596723.704265:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961612288:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 73us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596723.704355:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00080000:3.0:1789596723.704483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596723.704523:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596723.704526:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789596723.704528:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596723.704922:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961611904 00000100:00100000:0.0:1789596723.704929:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961611904 00000100:00100000:0.0:1789596723.704965:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 279 00000100:00100000:0.0:1789596723.704972:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961611904:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596723.705028:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961611904:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596723.705034:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 279 00000001:02000400:3.0:1789596724.520327:0:10695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789596724.672222:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596725.182799:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984746624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596725.182899:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596725.183000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746624 00000100:00100000:3.0:1789596725.183012:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746624 00000100:00100000:3.0:1789596725.183075:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596725.183087:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984746624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596725.183133:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596725.183198:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984746624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596725.183205:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596725.183265:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984746624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789596725.707009:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596726.207430:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984746752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596726.207504:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.207603:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596726.207611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984746880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596726.207636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.207695:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746752 00000100:00100000:3.0:1789596726.207704:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746752 00000100:00100000:3.0:1789596726.207769:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984746880 00000100:00100000:3.0:1789596726.207773:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984746880 00000100:00100000:3.0:1789596726.207791:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596726.207799:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984746752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596726.207828:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596726.207871:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984746752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.207877:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596726.207892:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789596726.207899:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984746880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596726.207908:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596726.207934:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984746880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.207940:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789596726.207956:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596726.207995:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f5f80 x1876527984746880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596726.208013:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984746880:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789596726.208040:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb211c00 x1876527984746752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596726.208050:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984746752:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789596726.717253:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596726.717567:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984747008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596726.717716:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596726.717969:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747008 00000100:00100000:1.0:1789596726.717982:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747008 00000100:00100000:1.0:1789596726.718080:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789596726.718095:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984747008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596726.718138:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596726.718201:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984747008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596726.718209:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789596726.718862:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984747136:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.718919:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.718961:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984747648:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.718991:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.719013:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984748160:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.719050:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.719077:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789596726.719084:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984747264:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.719106:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.719124:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984747776:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.719144:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.719161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984748288:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.719184:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596726.719219:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747648 00000100:00100000:3.0:1789596726.719225:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747648 00000100:00100000:3.0:1789596726.719268:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596726.719276:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984747648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.719474:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984747648:12345-0@lo:400:kworker.0 Request processed in 197us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.719500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596726.719901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748160 00000100:00100000:3.0:1789596726.719906:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748160 00000100:00100000:3.0:1789596726.719951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747264 00000100:00100000:3.0:1789596726.719955:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747264 00000100:00100000:3.0:1789596726.719969:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747776 00000100:00100000:3.0:1789596726.719972:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747776 00000100:00100000:3.0:1789596726.719985:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789596726.719992:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984748160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.720032:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984748160:12345-0@lo:400:kworker.0 Request processed in 40us (981us total) trans 0 rc 0/0 00000100:00080000:0.0:1789596726.720138:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596726.720143:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596726.720146:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596726.720159:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984747392:0@lo:400:kworker.0 00000100:00100000:0.0:1789596726.720193:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596726.720216:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984747904:0@lo:400:kworker.0 00000100:00100000:0.0:1789596726.720237:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596726.720247:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984748416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596726.720267:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596726.720366:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789596726.720375:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984747520:0@lo:400:kworker.0 00000100:00100000:0.0:1789596726.720424:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596726.720442:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984748032:0@lo:400:kworker.0 00000100:00100000:0.0:1789596726.720465:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596726.720491:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748416 00000100:00100000:0.0:1789596726.720495:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748416 00000100:00100000:0.0:1789596726.720703:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789596726.720712:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984748416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596726.720732:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596726.720782:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984748416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596726.720789:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789596726.720809:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596726.720819:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747392 00000100:00100000:0.0:1789596726.720823:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747392 00000100:00100000:0.0:1789596726.720842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596726.720849:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984747392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596726.720883:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984747392:12345-0@lo:400:kworker.0 Request processed in 34us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596726.720889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596726.720935:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984747392:0@lo:400:kworker.0 00010000:00080000:0.0:1789596726.720949:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b6a00 x1876527984748416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596726.720965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984748416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596726.721261:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747136 00000100:00100000:2.0:1789596726.721268:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747136 00000100:00100000:2.0:1789596726.721321:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789596726.721330:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984747136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596726.721375:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984747136:12345-0@lo:400:kworker.0 Request processed in 47us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596726.721392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789596726.721744:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789596726.721763:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747904 00000100:00100000:3.0:1789596726.721769:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747904 00000100:00100000:3.0:1789596726.721798:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984747520 00000100:00100000:3.0:1789596726.721802:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984747520 00000100:00100000:3.0:1789596726.721815:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748032 00000100:00100000:3.0:1789596726.721818:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748032 00000100:00100000:3.0:1789596726.721835:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789596726.721841:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984747264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.721883:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984747264:12345-0@lo:400:kworker.0 Request processed in 43us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.721889:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789596726.721900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789596726.721905:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984747776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.721931:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984747776:12345-0@lo:400:kworker.0 Request processed in 26us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.721936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789596726.721958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789596726.721963:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984747904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.721992:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984747904:12345-0@lo:400:kworker.0 Request processed in 29us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.721998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789596726.722009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789596726.722014:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984747520:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789596726.722291:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596726.722296:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596726.722423:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596726.722435:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984748032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596726.722473:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984748032:12345-0@lo:400:kworker.0 Request processed in 43us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596726.722479:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789596726.722533:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984747520:12345-0@lo:400:kworker.0 Request processed in 518us (2109us total) trans 0 rc 0/0 00010000:00080000:1.0:1789596726.722758:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4e00 x1876527984747008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596726.722783:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984747008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596726.722846:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984747520:0@lo:400:kworker.0 00000100:00100000:0.0:1789596726.722859:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984748032:0@lo:400:kworker.0 00010000:00080000:0.0:1789596726.722870:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd0380 x1876527984747904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596726.722879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984747904:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.722985:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789596726.723022:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748288 00000100:00100000:3.0:1789596726.723029:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748288 00000100:00100000:3.0:1789596726.723188:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596726.723196:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984748288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.723239:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984748288:12345-0@lo:400:kworker.0 Request processed in 45us (4054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596726.723245:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596726.723477:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984747264:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.723489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984747776:0@lo:400:kworker.0 00010000:00080000:3.0:1789596726.723500:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd2a00 x1876527984748288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596726.723509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984748288:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.723532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984747136:0@lo:400:kworker.0 00000100:00100000:3.0:1789596726.723846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984747648:0@lo:400:kworker.0 00010000:00080000:3.0:1789596726.723883:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd2680 x1876527984748160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596726.723892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984748160:0@lo:400:kworker.0 00010000:00010000:3.0:1789596727.742437:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596728.253816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984748544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596728.253913:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596728.254024:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748544 00000100:00100000:2.0:1789596728.254036:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748544 00000100:00100000:2.0:1789596728.254103:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789596728.254114:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984748544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596728.254157:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596728.254209:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984748544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596728.254216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789596728.254272:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984748544:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789596728.767216:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596728.839046:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596728.839104:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596728.839147:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596728.839188:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612800 00000100:00100000:2.0:1789596728.839202:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612800 00000100:00100000:2.0:1789596728.839286:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612672 00000100:00100000:2.0:1789596728.839290:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612672 00000100:00100000:2.0:1789596728.839322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1789596728.839335:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961612800:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596728.839477:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961612800:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596728.839520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1789596728.839543:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:2.0:1789596728.839550:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961612672:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596728.839582:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961612672:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596728.839588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00080000:2.0:1789596728.839607:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596728.839613:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596728.840168:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612544 00000100:00100000:3.0:1789596728.840177:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612544 00000100:00100000:3.0:1789596728.840236:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:3.0:1789596728.840245:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2406:x1876527961612544:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596728.840297:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2406:x1876527961612544:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 54us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596728.840304:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:3.0:1789596728.842838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596728.842917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596728.842917:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961612928 00000100:00100000:0.0:1789596728.842936:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961612928 00000100:00100000:3.0:1789596728.842982:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613056 00000100:00100000:3.0:1789596728.842997:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613056 00000100:00100000:0.0:1789596728.843122:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789596728.843137:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2405:x1876527961612928:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789596728.843205:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe920 00000100:00080000:0.0:1789596728.843230:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789596728.843303:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789596728.843381:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789596728.843397:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2405:x1876527961613056:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:3.0:1789596728.843438:0:8436:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe927 00000100:00080000:3.0:1789596728.843455:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596728.843508:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789596728.843714:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+2:2405:x1876527961613056:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 321us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596728.843725:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+2:2405:x1876527961612928:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 588us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596728.843726:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789596728.843744:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00080000:0.0:1789596728.843781:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596728.843788:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789596728.843952:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596728.845606:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596729.789976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596730.305267:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984748672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596730.305341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596730.305449:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748672 00000100:00100000:1.0:1789596730.305457:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748672 00000100:00100000:1.0:1789596730.305518:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789596730.305527:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984748672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596730.305560:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596730.305611:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984748672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596730.305619:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789596730.305720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984748672:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596730.812907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596731.034633:0:10939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing yml_node 00000100:00100000:3.0:1789596731.326912:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984748800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596731.326996:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596731.327109:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748800 00000100:00100000:0.0:1789596731.327118:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748800 00000100:00100000:0.0:1789596731.327188:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789596731.327199:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984748800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596731.327231:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596731.327279:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984748800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596731.327286:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789596731.327336:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596731.327365:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379c000 x1876527984748800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596731.327382:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984748800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596731.334290:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984748928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596731.334362:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.334442:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984748928 00000100:00100000:3.0:1789596731.334450:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984748928 00000100:00100000:3.0:1789596731.334510:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789596731.334518:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984748928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596731.334541:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596731.334584:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984748928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.334592:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789596731.334610:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596731.334639:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd2a00 x1876527984748928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596731.334657:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984748928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596731.836968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984749056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596731.837048:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596731.837186:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749056 00000100:00100000:1.0:1789596731.837196:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749056 00000100:00100000:1.0:1789596731.837243:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789596731.837252:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984749056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596731.837281:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596731.837329:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984749056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596731.837336:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789596731.837373:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5c00 x1876527984749056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596731.837393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984749056:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789596731.837655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789596731.838227:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596731.839105:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984749184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596731.839165:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596731.839241:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749184 00000100:00100000:1.0:1789596731.839247:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749184 00000100:00100000:1.0:1789596731.839293:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789596731.839301:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984749184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596731.839318:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596731.839359:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984749184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596731.839366:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789596731.839411:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789596731.839434:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5c00 x1876527984749184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596731.839451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984749184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596731.848454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984749696:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.848532:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.848577:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984750208:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.848600:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.848640:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789596731.848647:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984749312:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849227:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984749824:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984750336:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849297:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849327:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984749440:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849364:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849385:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984749952:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789596731.849426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984749568:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849446:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849463:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984750080:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.849505:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596731.849535:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749696 00000100:00100000:3.0:1789596731.849543:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749696 00000100:00100000:3.0:1789596731.849579:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750208 00000100:00100000:3.0:1789596731.849582:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750208 00000100:00100000:3.0:1789596731.849608:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750336 00000100:00100000:3.0:1789596731.849610:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750336 00000100:00100000:3.0:1789596731.850511:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749440 00000100:00100000:3.0:1789596731.850519:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749440 00000100:00100000:3.0:1789596731.850547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749952 00000100:00100000:3.0:1789596731.850551:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749952 00000100:00100000:3.0:1789596731.850564:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750080 00000100:00100000:3.0:1789596731.850566:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750080 00000100:00100000:3.0:1789596731.850583:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789596731.850591:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984749696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.850819:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984749696:12345-0@lo:400:kworker.0 Request processed in 227us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.850826:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789596731.850845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789596731.850851:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984750208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.850881:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984750208:12345-0@lo:400:kworker.0 Request processed in 30us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.850887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789596731.850898:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789596731.850905:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984750336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.850933:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984750336:12345-0@lo:400:kworker.0 Request processed in 29us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.850939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789596731.850959:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789596731.850965:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984749440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851002:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984749440:12345-0@lo:400:kworker.0 Request processed in 38us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.851009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789596731.851020:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789596731.851025:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984749952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851052:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984749952:12345-0@lo:400:kworker.0 Request processed in 27us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.851058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789596731.851069:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789596731.851074:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984750080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851100:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984750080:12345-0@lo:400:kworker.0 Request processed in 26us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.851106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789596731.851132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749312 00000100:00100000:3.0:1789596731.851135:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749312 00000100:00100000:3.0:1789596731.851161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789596731.851168:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984749312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851198:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984749312:12345-0@lo:400:kworker.0 Request processed in 30us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.851203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789596731.851232:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749824 00000100:00100000:3.0:1789596731.851235:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749824 00000100:00100000:3.0:1789596731.851253:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984749568 00000100:00100000:3.0:1789596731.851256:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984749568 00000100:00100000:3.0:1789596731.851278:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789596731.851283:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984749824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851317:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984749824:12345-0@lo:400:kworker.0 Request processed in 34us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.851323:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789596731.851334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789596731.851340:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984749568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851365:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984749568:12345-0@lo:400:kworker.0 Request processed in 26us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596731.851371:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789596731.851398:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596731.851402:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596731.851437:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984749568:0@lo:400:kworker.0 00010000:00080000:3.0:1789596731.851453:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83ded500 x1876527984750080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596731.851472:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984750080:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851485:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984749440:0@lo:400:kworker.0 00000100:00100000:3.0:1789596731.851499:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984749952:0@lo:400:kworker.0 00000100:00100000:2.0:1789596731.851604:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984749312:0@lo:400:kworker.0 00000100:00100000:2.0:1789596731.851616:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984749824:0@lo:400:kworker.0 00010000:00080000:2.0:1789596731.851640:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83ded880 x1876527984750336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596731.851649:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984750336:0@lo:400:kworker.0 00000100:00100000:2.0:1789596731.851661:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984749696:0@lo:400:kworker.0 00000100:00100000:2.0:1789596731.851702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984750208:0@lo:400:kworker.0 00010000:00010000:2.0:1789596732.869186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596733.373484:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596733.375357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984750464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596733.375498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596733.382828:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750464 00000100:00100000:3.0:1789596733.382845:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750464 00000100:00100000:3.0:1789596733.382917:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789596733.382928:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984750464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596733.382969:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596733.383068:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984750464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (7570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596733.383089:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596733.383598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984750464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789596733.885333:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789596733.892259:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:1.0:1789596733.892269:0:9514:0:(genops.c:885:class_export_put()) final put ffff9c7d8318f800/2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:3.0:1789596733.892441:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8318f800/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-OST0001 00000020:00000080:3.0:1789596733.892521:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d8318e000 for lustre-OST0001 00000100:00100000:0.0:1789596733.944749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596733.944796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596733.944831:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596733.944917:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613312 00000100:00100000:1.0:1789596733.944917:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613440 00000100:00100000:3.0:1789596733.944927:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613312 00000100:00100000:1.0:1789596733.944927:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613440 00000100:00100000:2.0:1789596733.945000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613184 00000100:00100000:2.0:1789596733.945004:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613184 00000100:00100000:1.0:1789596733.945004:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:1.0:1789596733.945014:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961613440:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596733.945032:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 283 00000100:00100000:2.0:1789596733.945038:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961613184:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596733.945096:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961613184:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596733.945126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 283 00000100:00100000:1.0:1789596733.945359:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961613440:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 345us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596733.945367:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:3.0:1789596733.946287:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:3.0:1789596733.946298:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961613312:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596733.946348:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961613312:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 52us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596733.946355:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00080000:0.0:1789596733.955973:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596733.955987:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1789596734.410541:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:1.0:1789596734.410552:0:8430:0:(genops.c:885:class_export_put()) final put ffff9c7d8318a000/2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:3.0:1789596734.410745:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8318a000/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-OST0000 00000020:00000080:3.0:1789596734.410801:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d8318e800 for lustre-OST0000 00010000:00010000:3.0:1789596734.908896:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789596735.367611:0:11123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1789596735.423023:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984750592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596735.423125:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596735.423200:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750592 00000100:00100000:3.0:1789596735.423208:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750592 00000100:00100000:3.0:1789596735.423255:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789596735.423262:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984750592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596735.423306:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596735.423352:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984750592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596735.423359:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789596735.423402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984750592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596735.933299:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596736.446145:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984750720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596736.446214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596736.446286:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596736.446294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984750848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596736.446317:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596736.446342:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750720 00000100:00100000:1.0:1789596736.446350:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750720 00000100:00080000:3.0:1789596736.446383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596736.446417:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750848 00000100:00100000:1.0:1789596736.446420:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750848 00000100:00100000:2.0:1789596736.446451:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789596736.446461:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984750720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596736.446491:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596736.446529:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789596736.446535:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984750720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596736.446538:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984750848:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596736.446541:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00002000:00000024:1.0:1789596736.446548:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596736.446577:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984750848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (259us total) trans 0 rc 0/0 00010000:00080000:2.0:1789596736.446578:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379dc00 x1876527984750720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596736.446583:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789596736.446595:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984750720:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789596736.446617:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd1180 x1876527984750848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596736.446627:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984750848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596736.446766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789596736.956847:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596736.957228:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984751360:0@lo:400:kworker.0 00000100:00100000:2.0:1789596736.957292:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596736.957354:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984751872:0@lo:400:kworker.0 00000100:00100000:2.0:1789596736.957374:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596736.957397:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984752384:0@lo:400:kworker.0 00000100:00100000:2.0:1789596736.957442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596736.957482:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789596736.957488:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984751232:0@lo:400:kworker.0 00000100:00100000:1.0:1789596736.957574:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751360 00000100:00100000:1.0:1789596736.957582:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751360 00000100:00100000:3.0:1789596736.957706:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984750976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596736.957737:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596736.957774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984751488:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.957784:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984750976 00000100:00100000:0.0:1789596736.957788:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984750976 00000100:00100000:3.0:1789596736.957810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596736.957827:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984752000:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.957841:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596736.957846:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.957849:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984750976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596736.957860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984752512:0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.957876:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789596736.957876:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596736.957891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789596736.957896:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984751104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596736.957913:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.957913:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984750976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.957919:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596736.957927:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984751616:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.957933:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751104 00000100:00100000:0.0:1789596736.957936:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751104 00000100:00100000:3.0:1789596736.957945:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.957953:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596736.957958:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984751104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596736.957960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984752128:0@lo:400:kworker.0 00002000:00000024:0.0:1789596736.957967:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596736.957979:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.957986:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984751104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.957992:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789596736.958002:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5500 x1876527984750976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596736.958020:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984750976:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789596736.958040:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379f800 x1876527984751104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596736.958051:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984751104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596736.958074:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752384 00000100:00100000:3.0:1789596736.958077:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752384 00000100:00100000:3.0:1789596736.958113:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752512 00000100:00100000:3.0:1789596736.958116:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752512 00000100:00100000:3.0:1789596736.958133:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789596736.958140:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984752384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.958168:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984752384:12345-0@lo:400:kworker.0 Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596736.958174:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789596736.958185:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596736.958191:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984752512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.958219:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984752512:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596736.958224:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596736.958242:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751488 00000100:00100000:3.0:1789596736.958246:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751488 00000100:00100000:3.0:1789596736.958270:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789596736.958276:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984751488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.958307:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984751488:12345-0@lo:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596736.958312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789596736.958328:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751872 00000100:00100000:0.0:1789596736.958333:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751872 00000100:00100000:3.0:1789596736.958341:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984751488:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.958350:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752000 00010000:00080000:3.0:1789596736.958351:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8372a680 x1876527984752512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596736.958352:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752000 00000100:00100000:3.0:1789596736.958359:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984752512:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.958363:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751616 00000100:00100000:0.0:1789596736.958365:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751616 00000100:00100000:0.0:1789596736.958374:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752128 00000100:00100000:0.0:1789596736.958376:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752128 00000100:00100000:3.0:1789596736.958391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789596736.958398:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984751872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.958447:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984751872:12345-0@lo:400:kworker.0 Request processed in 49us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596736.958454:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789596736.958466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789596736.958481:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789596736.958488:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984751616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596736.958511:0:6520:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789596736.958519:0:6520:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789596736.958524:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984751616:12345-0@lo:400:kworker.0 Request processed in 37us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.958530:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789596736.958542:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789596736.958554:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984752128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.958580:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984752128:12345-0@lo:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.958655:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789596736.958670:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789596736.958693:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984751360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.958735:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984751360:12345-0@lo:400:kworker.0 Request processed in 59us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.958740:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789596736.958766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596736.958770:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596736.958772:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596736.958789:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984751616:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.958799:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984752128:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.959811:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.959850:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984751744:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.959883:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.959900:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984752256:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.959919:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.959945:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984751360:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.959956:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984751872:0@lo:400:kworker.0 00010000:00080000:0.0:1789596736.959968:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729880 x1876527984752384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596736.959976:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984752384:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.960478:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752256 00000100:00100000:0.0:1789596736.960486:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752256 00000100:00100000:0.0:1789596736.960543:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789596736.960550:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984752256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.960609:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984752256:12345-0@lo:400:kworker.0 Request processed in 59us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.960615:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1789596736.960650:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729f80 x1876527984752256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596736.960661:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984752256:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.960727:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751232 00000100:00100000:0.0:1789596736.960732:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751232 00000100:00100000:0.0:1789596736.960757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789596736.960764:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984751232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.960802:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984751232:12345-0@lo:400:kworker.0 Request processed in 39us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.960807:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789596736.960837:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984751232:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.960860:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984751744 00000100:00100000:0.0:1789596736.960864:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984751744 00000100:00100000:0.0:1789596736.960886:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789596736.960893:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984751744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.960926:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984751744:12345-0@lo:400:kworker.0 Request processed in 34us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.960932:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789596736.960970:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984751744:0@lo:400:kworker.0 00000100:00080000:2.0:1789596736.961063:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596736.962595:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984752000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.963399:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984752000:12345-0@lo:400:kworker.0 Request processed in 4923us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596736.963409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1789596736.963460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729180 x1876527984752000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596736.963475:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984752000:0@lo:400:kworker.0 00000001:02000400:1.0:1789596737.713195:0:11221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:3.0:1789596737.980896:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596738.495315:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596738.495341:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984752640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596738.495427:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596738.495508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752640 00000100:00100000:0.0:1789596738.495517:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752640 00000100:00100000:0.0:1789596738.495564:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596738.495573:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984752640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789596738.495623:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596738.495672:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984752640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596738.495699:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596738.495748:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984752640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789596739.005020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596739.065648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596739.065765:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596739.065801:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596739.065855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613568 00000100:00100000:1.0:1789596739.065865:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613568 00000100:00100000:1.0:1789596739.065933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:1.0:1789596739.065944:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961613568:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596739.066038:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961613568:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 88us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596739.066044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:0.0:1789596739.066775:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613696 00000100:00100000:1.0:1789596739.066874:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613824 00000100:00100000:1.0:1789596739.066879:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613824 00000100:00100000:1.0:1789596739.066943:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:1.0:1789596739.066952:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961613824:12345-192.168.202.16@tcp:400:kworker.0 00000100:00080000:2.0:1789596739.066954:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596739.067006:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961613824:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 54us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596739.067013:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:0.0:1789596739.067491:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613696 00000100:00100000:0.0:1789596739.067587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:0.0:1789596739.067596:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961613696:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596739.067640:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961613696:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596739.067646:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00080000:2.0:1789596739.068277:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596740.030947:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596740.094284:0:11319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1789596740.544147:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596740.544173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984752768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596740.544244:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596740.544503:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752768 00000100:00100000:3.0:1789596740.544513:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752768 00000100:00100000:3.0:1789596740.544569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789596740.544578:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984752768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596740.544613:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596740.544701:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984752768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596740.544709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789596740.545025:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984752768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596741.053512:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596741.564982:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596741.565005:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984753024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596741.565077:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596741.565144:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753024 00000100:00100000:0.0:1789596741.565152:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753024 00000100:00100000:0.0:1789596741.565209:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596741.565220:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984753024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596741.565252:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596741.565296:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984753024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596741.565302:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789596741.565323:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789596741.565354:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379c700 x1876527984753024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596741.565371:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984753024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596741.565499:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984752896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596741.565528:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596741.565641:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984752896 00000100:00100000:0.0:1789596741.565645:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984752896 00000100:00100000:0.0:1789596741.565710:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789596741.565718:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984752896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596741.565729:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596741.565761:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984752896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596741.565767:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789596741.565851:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729500 x1876527984752896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596741.565875:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984752896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789596741.566215:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789596741.902893:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 18:12:21 EDT 2026 00000100:00100000:0.0:1789596742.078336:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984753152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596742.078760:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596742.078841:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753152 00000100:00100000:0.0:1789596742.078850:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753152 00000100:00100000:0.0:1789596742.078990:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596742.079002:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984753152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596742.079107:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596742.079158:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984753152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596742.079165:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789596742.079186:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596742.079216:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379c700 x1876527984753152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596742.079235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984753152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596742.079785:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984753408:0@lo:400:kworker.0 00000100:00100000:0.0:1789596742.079820:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596742.079842:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984753920:0@lo:400:kworker.0 00000100:00100000:0.0:1789596742.079861:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596742.079884:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984754432:0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.079995:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984753280:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.084877:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753408 00000100:00100000:1.0:1789596742.084891:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753408 00000100:00100000:1.0:1789596742.084951:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753920 00000100:00100000:1.0:1789596742.084966:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753920 00000100:00100000:1.0:1789596742.085002:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789596742.085012:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984753408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.085146:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596742.085188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984753792:0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.085216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596742.085237:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984754304:0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.085258:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596742.085289:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753280 00000100:00100000:2.0:1789596742.085293:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753280 00000100:00100000:2.0:1789596742.085320:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789596742.085327:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984753280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.085383:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984753280:12345-0@lo:400:kworker.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596742.085390:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789596742.085421:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753792 00000100:00100000:2.0:1789596742.085425:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753792 00000100:00100000:2.0:1789596742.085447:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789596742.085453:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984753792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596742.086515:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754304 00000100:00100000:0.0:1789596742.086522:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754304 00000100:00100000:0.0:1789596742.086553:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789596742.086561:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984753920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596742.086604:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984753920:12345-0@lo:400:kworker.0 Request processed in 45us (6742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596742.086623:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789596742.086651:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789596742.086657:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984754304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596742.086771:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984754304:12345-0@lo:400:kworker.0 Request processed in 114us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596742.086778:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:0.0:1789596742.086799:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596742.086828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596742.086832:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596742.086850:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596742.087050:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754432 00000100:00100000:3.0:1789596742.087055:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754432 00000100:00100000:3.0:1789596742.087092:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789596742.087100:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984754432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596742.087136:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984754432:12345-0@lo:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596742.087149:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789596742.087183:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596742.087542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984753920:0@lo:400:kworker.0 00010000:00080000:0.0:1789596742.087562:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837b7b80 x1876527984754432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596742.087570:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984754432:0@lo:400:kworker.0 00000100:00100000:3.0:1789596742.087961:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984753280:0@lo:400:kworker.0 00010000:00080000:3.0:1789596742.087976:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d826c1500 x1876527984754304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596742.087984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984754304:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.092292:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984753408:12345-0@lo:400:kworker.0 Request processed in 7264us (12452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596742.092306:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789596742.092437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984753536:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.092550:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596742.092575:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984754048:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.092599:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596742.092618:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984754560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596742.092641:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596742.092666:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789596742.092673:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984753664:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.092721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596742.092737:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984754176:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.092757:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596742.092784:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754560 00000100:00100000:1.0:1789596742.092792:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754560 00000100:00100000:1.0:1789596742.092827:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789596742.092835:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984754560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596742.092859:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596742.092996:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754048 00000100:00100000:3.0:1789596742.093001:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754048 00000100:00100000:3.0:1789596742.093038:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753664 00000100:00100000:3.0:1789596742.093041:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753664 00000100:00100000:3.0:1789596742.093059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754176 00000100:00100000:3.0:1789596742.093061:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754176 00000100:00100000:3.0:1789596742.093076:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789596742.093082:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984754048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596742.093153:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789596742.093163:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984753664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596742.093804:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984754048:12345-0@lo:400:kworker.0 Request processed in 719us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596742.093813:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789596742.093834:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789596742.093842:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984754176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596742.093873:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984754176:12345-0@lo:400:kworker.0 Request processed in 33us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596742.093879:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1789596742.093914:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596742.093919:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596742.094347:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984753664:12345-0@lo:400:kworker.0 Request processed in 1184us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596742.094365:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789596742.094769:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984753408:0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.097551:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984753792:12345-0@lo:400:kworker.0 Request processed in 12087us (12323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596742.097581:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789596742.097612:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984753536 00000100:00100000:2.0:1789596742.097621:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984753536 00000100:00100000:2.0:1789596742.097653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789596742.097661:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984753536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596742.097754:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984753536:12345-0@lo:400:kworker.0 Request processed in 93us (5203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596742.097760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789596742.098225:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984753792:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.098328:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984754560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5491us (5683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596742.098337:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789596742.098453:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984753664:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.098540:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984754176:0@lo:400:kworker.0 00000100:00100000:1.0:1789596742.098555:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984753536:0@lo:400:kworker.0 00010000:00080000:1.0:1789596742.098569:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379dc00 x1876527984754048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596742.098579:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984754048:0@lo:400:kworker.0 00010000:00080000:1.0:1789596742.098590:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b7480 x1876527984754560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596742.098605:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984754560:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789596743.103524:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596743.614266:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596743.614288:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984754688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596743.614993:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596743.618259:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754688 00000100:00100000:2.0:1789596743.618277:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754688 00000100:00100000:2.0:1789596743.618336:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789596743.618348:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984754688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596743.618398:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596743.619668:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984754688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1316us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596743.619700:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789596743.620720:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984754688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789596744.124999:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596744.183465:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596744.183587:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596744.183641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596744.184375:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614208 00000100:00100000:0.0:1789596744.184396:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614208 00000100:00100000:0.0:1789596744.184486:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614080 00000100:00100000:0.0:1789596744.184490:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614080 00000100:00100000:0.0:1789596744.184518:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:0.0:1789596744.184528:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961614208:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596744.184612:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961614208:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 85us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596744.184619:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:0.0:1789596744.184638:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:0.0:1789596744.184645:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961614080:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596744.184670:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961614080:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596744.184705:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:2.0:1789596744.184712:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961613952 00000100:00100000:2.0:1789596744.184718:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961613952 00000100:00100000:2.0:1789596744.184744:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 287 00000100:00100000:2.0:1789596744.184750:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961613952:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596744.184782:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2407:x1876527961613952:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596744.184788:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 287 00000100:00080000:3.0:1789596744.185113:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596744.185117:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789596745.149892:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596745.661065:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596745.661090:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984754816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596745.661168:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596745.661235:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754816 00000100:00100000:1.0:1789596745.661243:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754816 00000100:00100000:1.0:1789596745.661288:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596745.661297:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984754816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596745.661331:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596745.661387:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984754816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596745.661394:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596745.661439:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984754816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596746.173211:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596746.685278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984754944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596746.685410:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596746.686009:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984754944 00000100:00100000:0.0:1789596746.686020:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984754944 00000100:00100000:0.0:1789596746.686099:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596746.686109:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984754944:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596746.687515:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789596746.688809:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596746.688931:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984754944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2820us (3518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596746.688941:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789596746.689211:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4700 x1876527984754944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596746.689236:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984754944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596746.693707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984755072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596746.693765:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.693830:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755072 00000100:00100000:2.0:1789596746.693836:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755072 00000100:00100000:2.0:1789596746.693893:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789596746.693902:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984755072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596746.693924:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596746.693965:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984755072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.693972:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789596746.694008:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4700 x1876527984755072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596746.694021:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984755072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789596746.694103:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789596747.197058:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596747.198957:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596747.198978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984755200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596747.199048:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596747.199110:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755200 00000100:00100000:1.0:1789596747.199117:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755200 00000100:00100000:1.0:1789596747.199170:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789596747.199180:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984755200:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789596747.199198:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789596747.199209:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596747.199250:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984755200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596747.199257:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789596747.199440:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4700 x1876527984755200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596747.199458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984755200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596747.201142:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984755328:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.201230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596747.201348:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984755456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596747.201383:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596747.201424:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755456 00000100:00100000:3.0:1789596747.201431:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755456 00000100:00100000:3.0:1789596747.201480:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789596747.201488:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984755456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596747.201508:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596747.201550:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984755456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596747.201557:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789596747.201590:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729f80 x1876527984755456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596747.201610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984755456:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789596747.201631:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596747.201661:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596747.201669:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984755584:0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.201755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596747.201801:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984755712:0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.201832:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596747.202911:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984755840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.202965:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596747.203524:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755328 00000100:00100000:0.0:1789596747.203533:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755328 00000100:00100000:0.0:1789596747.203586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789596747.203597:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984755328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.203655:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984755328:12345-0@lo:400:kworker.0 Request processed in 61us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.203663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789596747.203718:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755584 00000100:00100000:0.0:1789596747.203722:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755584 00000100:00100000:0.0:1789596747.204120:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755840 00000100:00100000:0.0:1789596747.204126:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755840 00000100:00100000:0.0:1789596747.204167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789596747.204177:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984755584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.204237:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984755584:12345-0@lo:400:kworker.0 Request processed in 62us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.204244:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789596747.204263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789596747.204270:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984755840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.204305:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984755840:12345-0@lo:400:kworker.0 Request processed in 37us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.204312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789596747.204375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984755584:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.204406:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984755840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.204415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984755328:0@lo:400:kworker.0 00000100:00100000:2.0:1789596747.205305:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984755968:0@lo:400:kworker.0 00000100:00100000:2.0:1789596747.205364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596747.205427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755712 00000100:00100000:0.0:1789596747.205433:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755712 00000100:00100000:0.0:1789596747.205476:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984755968 00000100:00100000:0.0:1789596747.205480:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984755968 00000100:00100000:0.0:1789596747.205502:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789596747.205512:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984755712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.205566:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984755712:12345-0@lo:400:kworker.0 Request processed in 57us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.205573:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789596747.205593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789596747.205601:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984755968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596747.206747:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984756096:0@lo:400:kworker.0 00000100:00100000:1.0:1789596747.206795:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596747.206835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596747.206842:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984756224:0@lo:400:kworker.0 00000100:00100000:1.0:1789596747.206865:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596747.208230:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984755968:12345-0@lo:400:kworker.0 Request processed in 2625us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.208243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789596747.208300:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984755712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.208337:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984756352:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.208382:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596747.208430:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756096 00000100:00100000:0.0:1789596747.208437:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756096 00000100:00100000:0.0:1789596747.208481:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756224 00000100:00100000:0.0:1789596747.208484:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756224 00000100:00100000:0.0:1789596747.208505:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789596747.208513:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984756096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.208561:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984756096:12345-0@lo:400:kworker.0 Request processed in 49us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.208568:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789596747.208579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789596747.208585:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984756224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.208624:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984756224:12345-0@lo:400:kworker.0 Request processed in 39us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596747.208630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1789596747.208663:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83def100 x1876527984756224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596747.208675:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984756224:0@lo:400:kworker.0 00000100:00100000:0.0:1789596747.208705:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984756096:0@lo:400:kworker.0 00000100:00100000:1.0:1789596747.208746:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756352 00000100:00100000:1.0:1789596747.208751:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756352 00000100:00100000:1.0:1789596747.208784:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789596747.208790:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984756352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596747.208827:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984756352:12345-0@lo:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596747.208842:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789596747.211406:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dedc00 x1876527984756352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596747.211427:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984756352:0@lo:400:kworker.0 00000100:00080000:3.0:1789596747.211765:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596747.211772:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596747.212320:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596747.212346:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984756608:0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.212415:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596747.212457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756608 00000100:00100000:3.0:1789596747.212464:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756608 00000100:00100000:3.0:1789596747.212516:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789596747.212525:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984756608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.212576:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984756608:12345-0@lo:400:kworker.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596747.212583:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1789596747.212616:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596747.212633:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984756608:0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.212656:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984756736:0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.212673:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596747.212719:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756736 00000100:00100000:3.0:1789596747.212721:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756736 00000100:00100000:3.0:1789596747.212740:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789596747.212744:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984756736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.212772:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984756736:12345-0@lo:400:kworker.0 Request processed in 28us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596747.212776:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1789596747.212801:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789596747.212813:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83def800 x1876527984756736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596747.212822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984756736:0@lo:400:kworker.0 00000100:00100000:2.0:1789596747.215154:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984755968:0@lo:400:kworker.0 00000100:00100000:2.0:1789596747.215235:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984756480:0@lo:400:kworker.0 00000100:00100000:2.0:1789596747.215282:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596747.225397:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756480 00000100:00100000:3.0:1789596747.225417:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756480 00000100:00100000:3.0:1789596747.225470:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789596747.225478:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984756480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596747.225576:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984756480:12345-0@lo:400:kworker.0 Request processed in 99us (10292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596747.225584:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789596747.225634:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83ded880 x1876527984756480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596747.225646:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984756480:0@lo:400:kworker.0 00010000:00010000:0.0:1789596748.222054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596748.734798:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596748.734826:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984756864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596748.734921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596748.735071:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756864 00000100:00100000:0.0:1789596748.735080:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756864 00000100:00100000:0.0:1789596748.735132:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789596748.735140:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb029fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984756864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789596748.735175:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596748.735220:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb029fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984756864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596748.735227:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789596748.735820:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984756864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789596749.257106:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596749.303942:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596749.304172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614336 00000100:00100000:2.0:1789596749.304183:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614336 00000100:00100000:2.0:1789596749.304233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:2.0:1789596749.304243:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:2409:x1876527961614336:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596749.304336:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+10:2409:x1876527961614336:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596749.304356:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:2.0:1789596749.313017:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596749.314017:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614464 00000100:00100000:3.0:1789596749.314030:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614464 00000100:00080000:1.0:1789596749.314236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596749.314652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596749.314695:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614592 00000100:00100000:2.0:1789596749.314700:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614592 00000100:00100000:3.0:1789596749.315889:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:3.0:1789596749.315916:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961614464:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596749.316032:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961614464:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596749.316111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1789596749.316123:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961614592:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596749.316813:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961614592:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 691us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596749.316822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00080000:2.0:1789596749.316862:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596749.317868:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00010000:00010000:3.0:1789596750.270495:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596750.782006:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984756992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596750.782440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596750.782782:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984756992 00000100:00100000:1.0:1789596750.782792:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984756992 00000100:00100000:1.0:1789596750.783055:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789596750.783128:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984756992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596750.783375:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596750.783453:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984756992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 390us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596750.783461:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789596750.784077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984756992:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596751.294268:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596751.805275:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596751.805307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984757120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596751.805375:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596751.805445:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757120 00000100:00100000:3.0:1789596751.805454:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757120 00000100:00100000:3.0:1789596751.805513:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789596751.805523:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984757120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596751.805552:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596751.805593:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984757120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596751.805601:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789596751.805621:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596751.805650:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83ded880 x1876527984757120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596751.805669:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984757120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596751.808252:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596751.808293:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984757248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596751.808372:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596751.808545:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757248 00000100:00100000:1.0:1789596751.808554:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757248 00000100:00100000:1.0:1789596751.808627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596751.808638:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984757248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596751.808659:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596751.808744:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984757248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596751.808752:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789596751.808822:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789596751.808858:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b4a80 x1876527984757248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596751.808879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984757248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596752.317708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984757376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596752.317782:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.317878:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757376 00000100:00100000:0.0:1789596752.317886:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757376 00000100:00100000:0.0:1789596752.317943:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789596752.317954:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984757376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596752.317984:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596752.318028:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984757376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.318034:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789596752.318064:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596752.318095:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837b4000 x1876527984757376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596752.318114:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984757376:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789596752.320040:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596752.320462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984757760:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.320537:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596752.320568:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984758272:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.320591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596752.320618:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984758784:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.320639:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596752.320667:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789596752.320673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984757632:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.320721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596752.320741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984758144:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.320763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596752.320782:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984758656:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.320835:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596752.320865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757760 00000100:00100000:2.0:1789596752.320873:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757760 00000100:00100000:2.0:1789596752.320916:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758272 00000100:00100000:2.0:1789596752.320919:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758272 00000100:00100000:2.0:1789596752.320942:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758784 00000100:00100000:2.0:1789596752.320945:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758784 00000100:00100000:2.0:1789596752.320962:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789596752.320969:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984757760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321020:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984757760:12345-0@lo:400:kworker.0 Request processed in 50us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596752.321027:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789596752.321043:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789596752.321060:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984758272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321088:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984758272:12345-0@lo:400:kworker.0 Request processed in 40us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596752.321093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789596752.321105:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789596752.321111:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984758784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321135:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984758784:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596752.321140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789596752.321159:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758144 00000100:00100000:2.0:1789596752.321162:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758144 00000100:00100000:2.0:1789596752.321184:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789596752.321190:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984758144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321221:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984758144:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596752.321234:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789596752.321251:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758656 00000100:00100000:2.0:1789596752.321254:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758656 00000100:00100000:2.0:1789596752.321275:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789596752.321293:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984758656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321322:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984758656:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596752.321328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789596752.321362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984758144:0@lo:400:kworker.0 00010000:00080000:2.0:1789596752.321376:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb991b800 x1876527984758656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596752.321385:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984758656:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321395:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984757760:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984758272:0@lo:400:kworker.0 00000100:00100000:2.0:1789596752.321410:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984758784:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.323948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757632 00000100:00100000:0.0:1789596752.323964:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757632 00000100:00100000:0.0:1789596752.324058:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789596752.324070:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3647:x1876527984757632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324180:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3647:x1876527984757632:12345-0@lo:400:kworker.0 Request processed in 113us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.324199:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789596752.324258:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984757504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596752.324310:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324345:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984758016:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324367:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324386:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984758528:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324409:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324425:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984759040:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324450:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324472:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789596752.324479:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984757888:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324513:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984758400:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324553:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324569:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984758912:0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596752.324614:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757504 00000100:00100000:0.0:1789596752.324618:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757504 00000100:00100000:0.0:1789596752.324651:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596752.324658:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984757504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596752.324674:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596752.324738:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984757504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.324745:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596752.324771:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758016 00000100:00100000:0.0:1789596752.324775:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758016 00000100:00100000:0.0:1789596752.324798:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758400 00000100:00100000:0.0:1789596752.324813:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758400 00000100:00100000:0.0:1789596752.324834:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758912 00000100:00100000:0.0:1789596752.324837:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758912 00000100:00100000:0.0:1789596752.324852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789596752.324857:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984758016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324890:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984758016:12345-0@lo:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.324896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789596752.324908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596752.324913:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984758400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324938:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984758400:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.324943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596752.324953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596752.324958:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984758912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.324978:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984758912:12345-0@lo:400:kworker.0 Request processed in 20us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.324983:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596752.324996:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984757888 00000100:00100000:0.0:1789596752.324999:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984757888 00000100:00100000:0.0:1789596752.325018:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789596752.325024:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984757888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596752.325049:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984757888:12345-0@lo:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596752.325063:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789596752.325089:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596752.325094:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596752.325095:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596752.325131:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984757888:0@lo:400:kworker.0 00010000:00080000:0.0:1789596752.325144:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9918e00 x1876527984758400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596752.325154:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984758400:0@lo:400:kworker.0 00010000:00080000:0.0:1789596752.325163:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9919180 x1876527984758912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596752.325170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984758912:0@lo:400:kworker.0 00010000:00080000:0.0:1789596752.325178:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83728000 x1876527984757504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596752.325192:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984757504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596752.325199:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984758016:0@lo:400:kworker.0 00000100:00100000:3.0:1789596752.325792:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984757632:0@lo:400:kworker.0 00000100:00100000:3.0:1789596752.325829:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984758528 00000100:00100000:3.0:1789596752.325832:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984758528 00000100:00100000:3.0:1789596752.325858:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759040 00000100:00100000:3.0:1789596752.325861:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759040 00000100:00100000:3.0:1789596752.325879:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596752.325885:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984758528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596752.325924:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984758528:12345-0@lo:400:kworker.0 Request processed in 39us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596752.325929:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596752.325949:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596752.325955:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984759040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596752.325978:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984759040:12345-0@lo:400:kworker.0 Request processed in 23us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596752.325983:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789596752.326322:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9919500 x1876527984758528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596752.326332:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984758528:0@lo:400:kworker.0 00010000:00080000:3.0:1789596752.326341:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9919f80 x1876527984759040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596752.326348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984759040:0@lo:400:kworker.0 00010000:00010000:3.0:1789596753.341095:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596753.854014:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596753.854039:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984759168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596753.854110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596753.854178:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759168 00000100:00100000:3.0:1789596753.854185:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759168 00000100:00100000:3.0:1789596753.854240:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789596753.854249:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984759168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596753.854293:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596753.854347:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984759168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596753.854354:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789596753.854412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984759168:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789596754.365326:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596754.424764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596754.424799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596754.424835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596754.424969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614720 00000100:00100000:0.0:1789596754.424983:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614720 00000100:00100000:0.0:1789596754.425042:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:0.0:1789596754.425056:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2406:x1876527961614720:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596754.425157:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+10:2406:x1876527961614720:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596754.425165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:0.0:1789596754.425215:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614976 00000100:00100000:0.0:1789596754.425218:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614976 00000100:00100000:0.0:1789596754.425267:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961614848 00000100:00100000:0.0:1789596754.425271:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961614848 00000100:00100000:0.0:1789596754.425292:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:0.0:1789596754.425299:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961614976:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596754.425343:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961614976:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 41us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596754.425353:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:0.0:1789596754.425368:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:0.0:1789596754.425378:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961614848:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596754.425481:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961614848:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596754.425493:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00080000:1.0:1789596754.425823:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596754.425828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789596755.391562:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596755.902060:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984759296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596755.902151:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596755.902342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759296 00000100:00100000:1.0:1789596755.902353:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759296 00000100:00100000:1.0:1789596755.902421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789596755.902430:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984759296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596755.902466:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596755.902531:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984759296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596755.902538:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789596755.902584:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984759296:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596756.412959:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596756.925558:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984759424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596756.926348:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596756.926425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984759552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596756.926452:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596756.926622:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759424 00000100:00100000:3.0:1789596756.926632:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759424 00000100:00100000:3.0:1789596756.926715:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759552 00000100:00100000:3.0:1789596756.926719:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759552 00000100:00100000:3.0:1789596756.926737:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789596756.926746:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984759424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596756.926779:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596756.926828:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984759424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596756.926836:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789596756.926852:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789596756.926859:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984759552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596756.926869:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596756.926895:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984759552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596756.926900:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789596756.926940:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb98d7480 x1876527984759424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596756.926958:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984759424:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789596756.926968:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b6d80 x1876527984759552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596756.926978:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984759552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789596756.927160:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596757.437091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984759936:0@lo:400:kworker.0 00000100:00100000:2.0:1789596757.437160:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596757.437246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984760448:0@lo:400:kworker.0 00000100:00100000:2.0:1789596757.437272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596757.437282:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984759808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596757.437295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984760960:0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.437311:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596757.437325:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760448 00000100:00100000:1.0:1789596757.437332:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984760320:0@lo:400:kworker.0 00000100:00100000:2.0:1789596757.437334:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760448 00000100:00100000:1.0:1789596757.437351:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596757.437363:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984760832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.437379:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596757.437401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759808 00000100:00100000:2.0:1789596757.437404:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759808 00000100:00100000:1.0:1789596757.437412:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760320 00000100:00100000:1.0:1789596757.437415:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760320 00000100:00100000:2.0:1789596757.437417:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760832 00000100:00100000:2.0:1789596757.437419:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760832 00000100:00100000:2.0:1789596757.437433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789596757.437571:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984759680:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.437603:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.437627:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984760192:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.437647:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.437663:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984760704:0@lo:400:kworker.0 00000100:00100000:2.0:1789596757.437835:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984760448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596757.437888:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984760448:12345-0@lo:400:kworker.0 Request processed in 447us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.437928:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.437949:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984761216:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.437971:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.437988:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789596757.437993:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984760064:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438011:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.438021:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984760576:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438037:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.438054:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984761088:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596757.438102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759680 00000100:00100000:3.0:1789596757.438106:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759680 00000100:00100000:3.0:1789596757.438134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789596757.438141:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984759680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438176:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984759680:12345-0@lo:400:kworker.0 Request processed in 34us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438182:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789596757.438215:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984759936 00000100:00100000:3.0:1789596757.438219:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984759936 00000100:00100000:3.0:1789596757.438248:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760192 00000100:00100000:3.0:1789596757.438261:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760192 00000100:00100000:3.0:1789596757.438278:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789596757.438284:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984759936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438318:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984759936:12345-0@lo:400:kworker.0 Request processed in 35us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438324:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789596757.438335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789596757.438341:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984760192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438366:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984760192:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438371:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789596757.438400:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760704 00000100:00100000:3.0:1789596757.438404:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760704 00000100:00100000:3.0:1789596757.438421:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761216 00000100:00100000:3.0:1789596757.438424:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761216 00000100:00100000:3.0:1789596757.438436:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760576 00000100:00100000:3.0:1789596757.438439:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760576 00000100:00100000:3.0:1789596757.438449:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761088 00000100:00100000:3.0:1789596757.438451:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761088 00000100:00100000:3.0:1789596757.438467:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596757.438473:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984760704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438504:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984760704:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438510:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596757.438521:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596757.438526:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984761216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438552:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984761216:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438567:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596757.438579:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596757.438584:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984760576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438611:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984760576:12345-0@lo:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438616:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596757.438625:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596757.438631:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984761088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.438657:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984761088:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596757.438662:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789596757.438943:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760064 00000100:00100000:0.0:1789596757.438947:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760064 00010000:00080000:3.0:1789596757.439014:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8372aa00 x1876527984760576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596757.439028:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984760576:0@lo:400:kworker.0 00010000:00080000:3.0:1789596757.439037:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9919f80 x1876527984761088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596757.439045:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984761088:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.439053:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984759680:0@lo:400:kworker.0 00000100:00100000:3.0:1789596757.439061:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984760192:0@lo:400:kworker.0 00010000:00080000:3.0:1789596757.439069:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729880 x1876527984760704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596757.439076:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984760704:0@lo:400:kworker.0 00010000:00080000:3.0:1789596757.439095:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9919500 x1876527984761216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596757.439103:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984761216:0@lo:400:kworker.0 00010000:00010000:3.0:1789596757.439218:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789596757.439256:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596757.439261:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596757.439263:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596757.440258:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789596757.440277:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984759808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.440345:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984759808:12345-0@lo:400:kworker.0 Request processed in 79us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596757.440352:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789596757.440379:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789596757.440386:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984760832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.440412:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984760832:12345-0@lo:400:kworker.0 Request processed in 27us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596757.440418:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789596757.440428:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789596757.440434:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984760320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.440460:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984760320:12345-0@lo:400:kworker.0 Request processed in 26us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596757.440476:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789596757.440502:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984761344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596757.440534:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596757.440576:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984759808:0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.440587:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984760320:0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.440596:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984760832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.442550:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761344 00000100:00100000:1.0:1789596757.442564:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761344 00000100:00100000:1.0:1789596757.442634:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789596757.442644:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984761344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596757.442689:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596757.442768:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984761344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596757.442775:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789596757.442824:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820ab480 x1876527984761344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596757.442846:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984761344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596757.442927:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596757.442936:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984761472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596757.442966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596757.442994:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761472 00000100:00100000:1.0:1789596757.442998:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761472 00000100:00100000:1.0:1789596757.443018:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596757.443024:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984761472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596757.443048:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596757.443076:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984761472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596757.443083:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789596757.443103:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b7100 x1876527984761472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596757.443116:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984761472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596757.443153:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596757.443182:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984759936:0@lo:400:kworker.0 00010000:00080000:1.0:1789596757.443194:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83728380 x1876527984760448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596757.443203:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984760448:0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.443220:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984760960 00000100:00100000:1.0:1789596757.443223:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984760960 00000100:00100000:1.0:1789596757.443264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789596757.443270:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984760960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596757.443300:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984760960:12345-0@lo:400:kworker.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596757.443306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:1.0:1789596757.443327:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83729f80 x1876527984760960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596757.443337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984760960:0@lo:400:kworker.0 00000100:00080000:1.0:1789596757.443357:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596757.444357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789596757.444556:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789596757.444570:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984760064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596757.444638:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984760064:12345-0@lo:400:kworker.0 Request processed in 74us (6624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596757.444643:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789596757.444763:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984760064:0@lo:400:kworker.0 00000001:02000400:2.0:1789596758.334051:0:11996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:12:37 (1789596757) === 00010000:00010000:3.0:1789596758.460857:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596758.902988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596758.903090:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615104 00000100:00100000:0.0:1789596758.903101:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615104 00000100:00100000:0.0:1789596758.903158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 293 00000100:00100000:0.0:1789596758.903169:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+10:8739:x1876527961615104:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596758.903202:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596758.903232:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743c00/0x7b5398e289bbea15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e077f5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596758.903270:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743c00/0x7b5398e289bbea15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077f5 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596758.903289:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743c00/0x7b5398e289bbea15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077f5 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596758.903300:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743c00, rc 0) 00000100:00100000:0.0:1789596758.903369:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+11:8739:x1876527961615104:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 202us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596758.903376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 293 00000100:00100000:0.0:1789596758.919077:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596758.919226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615232 00000100:00100000:3.0:1789596758.919248:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615232 00000100:00100000:3.0:1789596758.919322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 294 00000100:00100000:3.0:1789596758.919338:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+11:8739:x1876527961615232:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789596758.919542:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+11:8739:x1876527961615232:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 209us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596758.919550:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 294 00000100:00100000:1.0:1789596758.926120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596758.926231:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615360 00000100:00100000:3.0:1789596758.926251:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615360 00000100:00100000:3.0:1789596758.926320:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:3.0:1789596758.926331:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+11:8739:x1876527961615360:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789596758.926489:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+11:8739:x1876527961615360:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 160us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596758.926497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:2.0:1789596758.956576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596758.956721:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615488 00000100:00100000:0.0:1789596758.956734:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615488 00000100:00100000:0.0:1789596758.956803:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:0.0:1789596758.956815:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+11:8743:x1876527961615488:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789596758.956989:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+11:8743:x1876527961615488:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 175us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596758.956998:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:1.0:1789596758.973037:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596758.973060:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984761600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596758.973133:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596758.973258:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761600 00000100:00100000:3.0:1789596758.973267:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761600 00000100:00100000:3.0:1789596758.973328:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789596758.973336:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984761600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596758.973384:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596758.973440:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984761600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596758.973447:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789596758.973724:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984761600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596758.982412:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596758.982479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615616 00000100:00100000:0.0:1789596758.982489:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615616 00000100:00100000:0.0:1789596758.982540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:0.0:1789596758.982549:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+11:8743:x1876527961615616:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789596758.983269:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+11:8743:x1876527961615616:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 714us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596758.983347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:1.0:1789596758.995200:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596758.995504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615744 00000100:00100000:3.0:1789596758.995514:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615744 00000100:00100000:3.0:1789596758.995570:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 298 00000100:00100000:3.0:1789596758.995579:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+11:8743:x1876527961615744:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596758.995769:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+11:8743:x1876527961615744:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 189us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596758.995776:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 298 00000100:00100000:1.0:1789596759.000976:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596759.001365:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961615872 00000100:00100000:0.0:1789596759.001375:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961615872 00000100:00100000:0.0:1789596759.001421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:0.0:1789596759.001431:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+11:8739:x1876527961615872:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596759.001448:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596759.001467:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbea1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07826 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596759.001493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbea1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07826 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596759.001502:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbea1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07826 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596759.001508:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743400, rc 0) 00000100:00100000:0.0:1789596759.001557:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:8739:x1876527961615872:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 129us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.001564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:0.0:1789596759.004841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596759.004941:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616000 00000100:00100000:2.0:1789596759.004951:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616000 00000100:00100000:2.0:1789596759.005001:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:2.0:1789596759.005010:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+12:8739:x1876527961616000:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789596759.005035:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789596759.005061:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789596759.005065:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789596759.005068:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789596759.005076:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789596759.005079:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789596759.007052:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+12:8739:x1876527961616000:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 2033us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596759.007062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:1.0:1789596759.010352:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596759.010452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616128 00000100:00100000:0.0:1789596759.010462:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616128 00000100:00100000:0.0:1789596759.010538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:0.0:1789596759.010548:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:8739:x1876527961616128:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596759.010564:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596759.010592:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0782d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596759.010965:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596759.010981:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596759.011001:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742c00, rc 0) 00000100:00100000:0.0:1789596759.011060:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8739:x1876527961616128:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 514us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.011067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:2.0:1789596759.013456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596759.013501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616256 00000100:00100000:0.0:1789596759.013511:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616256 00000100:00100000:0.0:1789596759.013596:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:0.0:1789596759.013606:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:8739:x1876527961616256:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789596759.014288:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:8739:x1876527961616256:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 681us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.014297:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:1.0:1789596759.016278:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596759.016368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616384 00000100:00100000:3.0:1789596759.016378:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616384 00000100:00100000:3.0:1789596759.016432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 303 00000100:00100000:3.0:1789596759.016443:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8739:x1876527961616384:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789596759.016577:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8739:x1876527961616384:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.016585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 303 00000100:00100000:1.0:1789596759.019489:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596759.019716:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616512 00000100:00100000:3.0:1789596759.019727:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616512 00000100:00100000:3.0:1789596759.019788:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 304 00000100:00100000:3.0:1789596759.019799:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8745:x1876527961616512:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596759.019954:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8745:x1876527961616512:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 156us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.019962:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 304 00000100:00100000:1.0:1789596759.030091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596759.030232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616640 00000100:00100000:3.0:1789596759.030244:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616640 00000100:00100000:3.0:1789596759.030351:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 305 00000100:00100000:3.0:1789596759.030363:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8745:x1876527961616640:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596759.030513:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:8745:x1876527961616640:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 152us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.030522:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 305 00000100:00100000:1.0:1789596759.037057:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596759.037156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596759.046140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596759.046528:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617408 00000100:00100000:2.0:1789596759.046539:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617408 00000100:00100000:2.0:1789596759.046869:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617536 00000100:00100000:2.0:1789596759.046873:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617536 00000100:00080000:3.0:1789596759.046938:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596759.046943:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596759.046976:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:3.0:1789596759.046989:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961617408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596759.047073:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961617408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 87us (10026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.047081:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1789596759.048510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596759.048582:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616768 00000100:00100000:3.0:1789596759.048591:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616768 00000100:00100000:3.0:1789596759.049012:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617024 00000100:00100000:3.0:1789596759.049017:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617024 00000100:00100000:0.0:1789596759.049076:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:0.0:1789596759.049090:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961617536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596759.049156:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961617536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 72us (12001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.049164:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:0.0:1789596759.049184:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789596759.049188:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1876527961616768:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789596759.049237:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d191948b-51c9-4843-830f-05feb1db7f03@192.168.202.16@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1789596759.049272:0:6520:0:(genops.c:1384:class_connect()) connect: client d191948b-51c9-4843-830f-05feb1db7f03, cookie 0x7b5398e289bbea2a 00000004:00100000:0.0:1789596759.049297:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789596759.049405:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c1b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596759.049433:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+6:2405:x1876527961616768:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 243us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.049441:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789596759.049454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789596759.049459:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1876527961617024:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789596759.049473:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from d191948b-51c9-4843-830f-05feb1db7f03@192.168.202.16@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1789596759.049495:0:6520:0:(genops.c:1384:class_connect()) connect: client d191948b-51c9-4843-830f-05feb1db7f03, cookie 0x7b5398e289bbea31 00000004:00100000:0.0:1789596759.049506:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789596759.049554:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c19800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596759.049575:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+6:2405:x1876527961617024:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 114us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.049581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789596759.053606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596759.053652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596759.053739:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596759.053979:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961616896 00000100:00100000:3.0:1789596759.053990:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961616896 00000100:00100000:3.0:1789596759.054088:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617152 00000100:00100000:3.0:1789596759.054091:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617152 00000100:00100000:3.0:1789596759.054105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617280 00000100:00100000:3.0:1789596759.054108:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617280 00000100:00100000:3.0:1789596759.054121:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789596759.054130:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+7:0:x1876527961616896:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789596759.054168:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596759.054261:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+7:0:x1876527961616896:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 131us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.054280:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789596759.054298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789596759.054305:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:0:x1876527961617152:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789596759.054320:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596759.054357:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:0:x1876527961617152:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 52us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.054364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789596759.054376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:3.0:1789596759.054382:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961617280:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789596759.054394:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596759.054416:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961617280:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 34us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.054422:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00080000:1.0:1789596759.054760:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596759.054765:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596759.056535:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596759.056608:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617664 00000100:00100000:3.0:1789596759.058036:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617664 00000100:00100000:3.0:1789596759.058122:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789596759.058134:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961617664:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789596759.058247:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961617664:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 115us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.058255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789596759.061501:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596759.061542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596759.061573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596759.061672:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617792 00000100:00100000:0.0:1789596759.061701:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617792 00000100:00100000:0.0:1789596759.061743:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961617920 00000100:00100000:0.0:1789596759.061746:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961617920 00000100:00100000:0.0:1789596759.061764:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:0.0:1789596759.061773:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1876527961617792:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596759.061807:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d191948b-51c9-4843-830f-05feb1db7f03@192.168.202.16@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1789596759.061839:0:8435:0:(genops.c:1384:class_connect()) connect: client d191948b-51c9-4843-830f-05feb1db7f03, cookie 0x7b5398e289bbea38 00002000:00100000:0.0:1789596759.061849:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d191948b-51c9-4843-830f-05feb1db7f03/ffff9c7d83c1e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596759.061880:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596759.061954:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789596759.061985:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c18800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596759.062054:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:2405:x1876527961617792:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 281us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.062062:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:0.0:1789596759.062079:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789596759.062083:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1876527961617920:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596759.062100:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d191948b-51c9-4843-830f-05feb1db7f03@192.168.202.16@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1789596759.062118:0:8435:0:(genops.c:1384:class_connect()) connect: client d191948b-51c9-4843-830f-05feb1db7f03, cookie 0x7b5398e289bbea3f 00002000:00100000:0.0:1789596759.062123:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d191948b-51c9-4843-830f-05feb1db7f03/ffff9c7d83c19000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596759.062129:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596759.062166:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596759.062179:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c1f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596759.062203:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:2405:x1876527961617920:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 117us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.062210:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789596759.062922:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618048 00000100:00100000:2.0:1789596759.062930:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618048 00000100:00100000:2.0:1789596759.062976:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789596759.062984:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961618048:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789596759.063033:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961618048:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 50us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596759.063041:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789596759.066262:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596759.066372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618176 00000100:00100000:0.0:1789596759.066384:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618176 00000100:00100000:0.0:1789596759.066475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789596759.066485:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961618176:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789596759.066575:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789596759.066746:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:8739:x1876527961618176:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 254us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596759.066773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00010000:00010000:3.0:1789596759.485137:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596760.526315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596761.023828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984761728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596761.023907:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596761.025338:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761728 00000100:00100000:1.0:1789596761.025349:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761728 00000100:00100000:1.0:1789596761.025404:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596761.025425:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984761728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596761.025465:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596761.025539:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984761728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596761.025547:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596761.025598:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984761728:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596761.534654:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596762.045033:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596762.045058:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984761856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596762.045148:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596762.045245:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761856 00000100:00100000:3.0:1789596762.045254:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761856 00000100:00100000:3.0:1789596762.045311:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789596762.045320:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984761856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596762.045352:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596762.045412:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984761856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596762.045419:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789596762.045441:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789596762.045479:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820a9500 x1876527984761856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596762.045511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984761856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596762.045923:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984761984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596762.045954:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596762.045991:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984761984 00000100:00100000:3.0:1789596762.045995:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984761984 00000100:00100000:3.0:1789596762.046024:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789596762.046031:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984761984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596762.046043:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596762.046073:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984761984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596762.046080:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789596762.046094:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596762.046113:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb17bb80 x1876527984761984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596762.046125:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984761984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596762.556869:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789596762.556882:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596762.556890:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984762112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596762.556971:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596762.557012:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762112 00000100:00100000:3.0:1789596762.557033:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762112 00000100:00100000:3.0:1789596762.557087:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596762.557097:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb692d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984762112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596762.557124:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596762.557180:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb692d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984762112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596762.557198:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789596762.557227:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596762.557287:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb178e00 x1876527984762112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596762.557306:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984762112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596762.557495:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596762.557699:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984762368:0@lo:400:kworker.0 00000100:00100000:1.0:1789596762.557735:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596762.557801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762368 00000100:00100000:2.0:1789596762.557807:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762368 00000100:00100000:2.0:1789596762.557851:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789596762.557858:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984762368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.557965:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984762368:12345-0@lo:400:kworker.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596762.557973:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789596762.558155:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984762368:0@lo:400:kworker.0 00000100:00100000:1.0:1789596762.558175:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596762.558178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984762624:0@lo:400:kworker.0 00000100:00100000:1.0:1789596762.558180:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984762496:0@lo:400:kworker.0 00000100:00100000:1.0:1789596762.558214:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.558214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.558235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984762240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596762.558258:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596762.558284:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762496 00000100:00100000:2.0:1789596762.558289:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762496 00000100:00100000:0.0:1789596762.558293:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762624 00000100:00100000:0.0:1789596762.558296:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762624 00000100:00100000:0.0:1789596762.558321:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596762.558324:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789596762.558327:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984762624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.558330:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984762496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.558364:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984762624:12345-0@lo:400:kworker.0 Request processed in 37us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596762.558367:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984762496:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.558370:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596762.558373:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789596762.558399:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984762624:0@lo:400:kworker.0 00000100:00100000:1.0:1789596762.558438:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762240 00000100:00100000:1.0:1789596762.558443:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762240 00000100:00100000:1.0:1789596762.558485:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789596762.558492:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984762240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596762.558504:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596762.558540:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984762240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596762.558547:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789596762.558570:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984762496:0@lo:400:kworker.0 00000100:00080000:0.0:1789596762.558824:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596762.558846:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb9919180 x1876527984762240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596762.558862:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984762240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596762.559400:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984762752:0@lo:400:kworker.0 00000100:00100000:1.0:1789596762.559443:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.559594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762752 00000100:00100000:0.0:1789596762.559599:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762752 00000100:00100000:0.0:1789596762.559649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596762.559657:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984762752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.559805:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984763136:0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.559834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.559918:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984762752:12345-0@lo:400:kworker.0 Request processed in 262us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.559926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596762.559940:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763136 00000100:00100000:0.0:1789596762.559943:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763136 00000100:00100000:0.0:1789596762.559979:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789596762.559984:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984763136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.560017:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984763136:12345-0@lo:400:kworker.0 Request processed in 33us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.560037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789596762.560054:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984763008:0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.560078:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.560096:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596762.560101:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984762880:0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.560123:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.560157:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763008 00000100:00100000:0.0:1789596762.560161:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763008 00000100:00100000:0.0:1789596762.560198:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596762.560205:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984763008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.560239:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984763008:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.560245:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596762.560263:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984762880 00000100:00100000:0.0:1789596762.560266:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984762880 00000100:00100000:0.0:1789596762.560289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789596762.560314:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984762880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.560343:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984762880:12345-0@lo:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.560349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789596762.560377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984762880:0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.560386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984763008:0@lo:400:kworker.0 00010000:00080000:0.0:1789596762.560412:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820abb80 x1876527984763136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596762.560433:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984763136:0@lo:400:kworker.0 00000100:00080000:2.0:1789596762.560515:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596762.560520:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596762.560836:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984763392:0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.560867:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596762.560893:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596762.560898:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984763520:0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.560917:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596762.560976:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763392 00000100:00100000:3.0:1789596762.560981:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763392 00000100:00100000:0.0:1789596762.561072:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763520 00000100:00100000:0.0:1789596762.561076:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763520 00000100:00100000:0.0:1789596762.561107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789596762.561113:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984763520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596762.561223:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789596762.561231:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984763392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596762.561270:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984763392:12345-0@lo:400:kworker.0 Request processed in 41us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596762.561276:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789596762.561321:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984763520:12345-0@lo:400:kworker.0 Request processed in 207us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.561327:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789596762.561342:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596762.561353:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984763648:0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.561376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596762.561394:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596762.561400:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984763264:0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.561431:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596762.561547:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984762752:0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.561755:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763648 00000100:00100000:0.0:1789596762.561759:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763648 00000100:00100000:0.0:1789596762.561790:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789596762.561808:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984763648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.561843:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984763648:12345-0@lo:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.561849:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789596762.561863:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789596762.561883:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820abb80 x1876527984763648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596762.561893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984763648:0@lo:400:kworker.0 00000100:00100000:2.0:1789596762.562006:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763264 00000100:00100000:2.0:1789596762.562010:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763264 00000100:00100000:0.0:1789596762.562101:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789596762.562108:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984763264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596762.562140:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984763264:12345-0@lo:400:kworker.0 Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.562156:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789596762.562177:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820a9500 x1876527984763264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596762.562198:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984763264:0@lo:400:kworker.0 00000100:00100000:3.0:1789596762.562489:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984763520:0@lo:400:kworker.0 00010000:00080000:3.0:1789596762.562505:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820a8a80 x1876527984763392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596762.562514:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984763392:0@lo:400:kworker.0 00010000:00010000:3.0:1789596763.581568:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596764.103039:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984763776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596764.103117:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596764.104354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763776 00000100:00100000:2.0:1789596764.104366:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763776 00000100:00100000:2.0:1789596764.104430:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596764.104443:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984763776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596764.104479:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596764.104552:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984763776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.104559:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789596764.105422:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984763776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596764.156656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596764.156795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618304 00000100:00100000:3.0:1789596764.156809:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618304 00000100:00100000:3.0:1789596764.156890:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 307 00000100:00100000:3.0:1789596764.156904:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961618304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596764.157025:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961618304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596764.157034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 307 00000100:00100000:1.0:1789596764.158384:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596764.158422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596764.158463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596764.158489:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596764.158509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596764.158540:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596764.158572:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619072 00000100:00100000:1.0:1789596764.158582:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619072 00000100:00100000:1.0:1789596764.158647:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618944 00000100:00100000:1.0:1789596764.158651:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618944 00000100:00100000:0.0:1789596764.158791:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618560 00000100:00100000:0.0:1789596764.158796:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618560 00000100:00100000:0.0:1789596764.158830:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618816 00000100:00100000:0.0:1789596764.158833:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618816 00000100:00100000:0.0:1789596764.158848:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618432 00000100:00100000:0.0:1789596764.158850:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618432 00000100:00100000:0.0:1789596764.158865:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961618688 00000100:00100000:0.0:1789596764.158867:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961618688 00000100:00100000:0.0:1789596764.158886:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:0.0:1789596764.158896:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961618560:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596764.159015:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961618560:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 120us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.159023:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:0.0:1789596764.159042:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:0.0:1789596764.159048:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961618816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596764.159073:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961618816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.159079:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:0.0:1789596764.159089:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:0.0:1789596764.159095:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961618432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596764.159120:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961618432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.159125:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:0.0:1789596764.159136:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:0.0:1789596764.159142:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961618688:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596764.159164:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961618688:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.159182:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00080000:0.0:1789596764.159231:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596764.159236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596764.159239:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596764.159241:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596764.159264:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789596764.159272:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961619072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596764.159309:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961619072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.159315:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789596764.159331:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:0.0:1789596764.159337:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961618944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596764.159360:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+6:2407:x1876527961618944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.159365:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00010000:00010000:1.0:1789596764.606045:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596765.090608:0:12190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1789596765.125916:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000001:00100000:2.0:1789596765.141775:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000001:00100000:3.0:1789596765.145060:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000001:00100000:3.0:1789596765.145415:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00010000:00010000:3.0:1789596765.629495:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596766.145289:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984763904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596766.145400:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596766.146056:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984763904 00000100:00100000:2.0:1789596766.146070:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984763904 00000100:00100000:2.0:1789596766.146143:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789596766.146163:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984763904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789596766.146230:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789596766.146916:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984763904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 759us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.146938:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789596766.151050:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984763904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596766.666588:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596767.179545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984764032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596767.180312:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596767.180421:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764032 00000100:00100000:3.0:1789596767.181126:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764032 00000100:00100000:3.0:1789596767.181535:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789596767.181550:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984764032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596767.181594:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596767.183579:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984764032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2020us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596767.183598:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789596767.184168:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596767.185397:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820ab480 x1876527984764032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596767.186794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984764032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596767.187506:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984764160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596767.187602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596767.190579:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764160 00000100:00100000:3.0:1789596767.190603:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764160 00000100:00100000:3.0:1789596767.191807:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789596767.191827:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984764160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596767.191864:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789596767.192900:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820ab480 x1876527984764160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596767.192929:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984764160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596767.194353:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984764160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2520us (6737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596767.194380:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789596767.194721:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596767.676990:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984764288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596767.677099:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596767.677221:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764288 00000100:00100000:3.0:1789596767.677231:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764288 00000100:00100000:3.0:1789596767.677300:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789596767.677311:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984764288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596767.677352:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596767.677409:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984764288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596767.677417:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789596767.677443:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789596767.677592:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6680 x1876527984764288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596767.677614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984764288:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789596767.677854:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596767.677874:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984764544:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.677916:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.677946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984765056:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.677968:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.677989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984765568:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678030:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789596767.678036:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984764416:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678090:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678117:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678150:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984765440:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678203:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764544 00000100:00100000:1.0:1789596767.678208:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764544 00000100:00100000:1.0:1789596767.678245:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765056 00000100:00100000:1.0:1789596767.678249:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765056 00000100:00100000:1.0:1789596767.678269:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765568 00000100:00100000:1.0:1789596767.678272:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765568 00000100:00100000:1.0:1789596767.678286:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765440 00000100:00100000:1.0:1789596767.678289:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765440 00000100:00100000:1.0:1789596767.678303:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596767.678310:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984764544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678358:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984764544:12345-0@lo:400:kworker.0 Request processed in 48us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.678365:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596767.678381:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789596767.678395:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984765056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678426:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984765056:12345-0@lo:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.678432:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789596767.678445:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789596767.678451:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984765568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678478:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984765568:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.678484:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789596767.678495:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789596767.678501:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984765440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678529:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984765440:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.678536:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789596767.678564:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764416 00000100:00100000:1.0:1789596767.678568:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764416 00000100:00100000:1.0:1789596767.678597:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789596767.678603:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3647:x1876527984764416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678634:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3647:x1876527984764416:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.678640:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789596767.678668:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764928 00000100:00100000:1.0:1789596767.678671:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764928 00000100:00100000:1.0:1789596767.678725:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789596767.678732:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984764928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678767:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984764928:12345-0@lo:400:kworker.0 Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.678781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789596767.678814:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596767.678818:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596767.678831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984764800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678880:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984765312:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678902:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678923:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789596767.678930:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984764672:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678953:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.678969:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984765184:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.678989:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.679006:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984765696:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679025:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.679053:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765312 00000100:00100000:1.0:1789596767.679057:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765312 00000100:00100000:1.0:1789596767.679082:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765696 00000100:00100000:1.0:1789596767.679085:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765696 00000100:00100000:1.0:1789596767.679109:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789596767.679114:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984765312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679163:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984765312:12345-0@lo:400:kworker.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.679168:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789596767.679179:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789596767.679185:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984765696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679225:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984765696:12345-0@lo:400:kworker.0 Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.679232:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789596767.679254:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764800 00000100:00100000:1.0:1789596767.679257:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764800 00000100:00100000:1.0:1789596767.679278:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765184 00000100:00100000:1.0:1789596767.679280:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765184 00000100:00100000:1.0:1789596767.679299:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789596767.679304:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984764800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679341:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984764800:12345-0@lo:400:kworker.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.679348:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789596767.679358:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789596767.679363:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984765184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679390:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984765184:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.679395:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1789596767.679414:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596767.679417:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596767.679423:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984764672 00000100:00100000:1.0:1789596767.679427:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984764672 00000100:00100000:1.0:1789596767.679446:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789596767.679453:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679484:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984764672:12345-0@lo:400:kworker.0 Request processed in 32us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.679490:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789596767.679528:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984764416:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679553:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984765440:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679576:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984764544:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679587:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984765056:0@lo:400:kworker.0 00010000:00080000:1.0:1789596767.679600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b3800 x1876527984765568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596767.679611:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984765568:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679656:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984764672:0@lo:400:kworker.0 00010000:00080000:1.0:1789596767.679665:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b7b80 x1876527984765184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596767.679673:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984765184:0@lo:400:kworker.0 00010000:00080000:1.0:1789596767.679710:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b2d80 x1876527984765696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596767.679719:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984765696:0@lo:400:kworker.0 00000100:00100000:1.0:1789596767.679730:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984764800:0@lo:400:kworker.0 00010000:00080000:1.0:1789596767.679738:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6300 x1876527984765312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596767.679744:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984765312:0@lo:400:kworker.0 00000100:00100000:3.0:1789596767.680416:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596767.680432:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984765824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596767.680482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596767.680524:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765824 00000100:00100000:3.0:1789596767.680530:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765824 00000100:00100000:3.0:1789596767.680569:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789596767.680578:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984765824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596767.680601:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596767.680643:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984765824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596767.680656:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1789596767.680710:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820a8a80 x1876527984765824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596767.680726:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984765824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789596768.700948:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596769.222049:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984765952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596769.222162:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596769.222366:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984765952 00000100:00100000:1.0:1789596769.222378:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984765952 00000100:00100000:1.0:1789596769.222471:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789596769.222483:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984765952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596769.222531:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596769.222606:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984765952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.222614:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789596769.222835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984765952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596769.293629:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293708:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293737:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293802:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293858:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596769.293908:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619456 00000100:00100000:0.0:1789596769.293922:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619456 00000100:00100000:0.0:1789596769.294004:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619712 00000100:00100000:0.0:1789596769.294008:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619712 00000100:00100000:0.0:1789596769.294022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619328 00000100:00100000:0.0:1789596769.294025:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619328 00000100:00100000:0.0:1789596769.294038:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619584 00000100:00100000:0.0:1789596769.294040:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619584 00000100:00100000:0.0:1789596769.294058:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:0.0:1789596769.294069:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961619456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.294191:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961619456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.294201:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:0.0:1789596769.294223:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:0.0:1789596769.294230:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619712:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.294257:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619712:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.294262:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:0.0:1789596769.294273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1789596769.294279:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961619328:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.294301:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961619328:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.294306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1789596769.294316:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:0.0:1789596769.294321:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619584:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.294343:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619584:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.294348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:0.0:1789596769.294373:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619968 00000100:00100000:0.0:1789596769.294377:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619968 00000100:00100000:0.0:1789596769.294421:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619840 00000100:00100000:0.0:1789596769.294425:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619840 00000100:00100000:0.0:1789596769.294450:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789596769.294457:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619968:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.294493:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619968:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.294499:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789596769.294512:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789596769.294518:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619840:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.294544:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961619840:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.294549:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00080000:0.0:1789596769.294578:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596769.294582:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596769.294585:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596769.294587:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596769.295062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961619200 00000100:00100000:1.0:1789596769.295069:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961619200 00000100:00100000:1.0:1789596769.295118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 309 00000100:00100000:1.0:1789596769.295136:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961619200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596769.295178:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961619200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.295184:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 309 00010000:00010000:0.0:1789596769.725189:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596770.757299:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596771.262005:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984766080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596771.262098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596771.262488:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766080 00000100:00100000:1.0:1789596771.262497:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766080 00000100:00100000:1.0:1789596771.262557:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789596771.262567:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984766080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596771.262607:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596771.263159:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984766080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 590us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596771.263176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789596771.264271:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984766080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596771.772881:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596772.285835:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596772.285857:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984766208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596772.285924:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596772.285988:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766208 00000100:00100000:3.0:1789596772.285997:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766208 00000100:00100000:3.0:1789596772.286063:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596772.286072:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984766208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596772.286114:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596772.286160:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984766208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596772.286166:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1789596772.286204:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820a8a80 x1876527984766208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596772.286223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984766208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596772.287903:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596772.291017:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984766336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596772.291112:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596772.291208:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766336 00000100:00100000:0.0:1789596772.291219:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766336 00000100:00100000:0.0:1789596772.291284:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789596772.291304:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984766336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596772.291328:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789596772.292731:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596772.300037:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984766336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8712us (8902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596772.300055:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789596772.302477:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb991bb80 x1876527984766336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596772.302534:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984766336:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789596772.797121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596772.797270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984766464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596772.797342:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596772.797574:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766464 00000100:00100000:3.0:1789596772.797583:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766464 00000100:00100000:3.0:1789596772.797658:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596772.797670:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984766464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596772.797764:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596772.797812:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984766464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596772.797820:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789596772.799430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984766592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596772.799490:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789596772.799658:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789596772.799721:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d820a8e00 x1876527984766464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596772.799743:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984766464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596772.799821:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766592 00000100:00100000:1.0:1789596772.799830:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766592 00000100:00100000:1.0:1789596772.799901:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789596772.799910:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984766592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596772.799940:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596772.799984:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984766592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596772.799991:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789596772.800016:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb024700 x1876527984766592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596772.800029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984766592:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789596772.800188:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596772.801723:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.801799:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596772.801842:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984767232:0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.801949:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596772.801950:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984766848:0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.801977:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984767744:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.801982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596772.802004:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767232 00000100:00100000:2.0:1789596772.802011:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767232 00000100:00100000:0.0:1789596772.802012:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984767360:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802033:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596772.802069:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766848 00000100:00100000:0.0:1789596772.802073:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766848 00000100:00100000:0.0:1789596772.802123:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767360 00000100:00100000:0.0:1789596772.802126:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767360 00000100:00100000:2.0:1789596772.802130:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789596772.802137:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802151:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789596772.802156:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984766848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.802185:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984767232:12345-0@lo:400:kworker.0 Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596772.802185:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984766848:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596772.802193:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789596772.802193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789596772.802207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789596772.802212:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984767360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802238:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984767360:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596772.802242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789596772.802282:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984766848:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802305:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984767360:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596772.802353:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802368:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767744 00000100:00100000:0.0:1789596772.802372:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767744 00000100:00100000:0.0:1789596772.802395:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789596772.802401:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984767744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.802435:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984767744:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596772.802449:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:0.0:1789596772.802478:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83def800 x1876527984767744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596772.802489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984767744:0@lo:400:kworker.0 00000100:00080000:0.0:1789596772.802535:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596772.802539:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596772.802918:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766720 00000100:00100000:3.0:1789596772.802923:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766720 00000100:00100000:3.0:1789596772.802961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789596772.802968:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984766720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596772.803016:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984766720:12345-0@lo:400:kworker.0 Request processed in 48us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596772.803031:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789596772.804365:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984766720:0@lo:400:kworker.0 00000100:00100000:1.0:1789596772.804458:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984767104:0@lo:400:kworker.0 00000100:00100000:1.0:1789596772.804521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596772.804561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984767616:0@lo:400:kworker.0 00000100:00100000:1.0:1789596772.804579:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596772.804607:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789596772.804613:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984766976:0@lo:400:kworker.0 00000100:00100000:1.0:1789596772.804635:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596772.804651:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984767488:0@lo:400:kworker.0 00000100:00100000:1.0:1789596772.804671:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596772.810278:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767104 00000100:00100000:2.0:1789596772.810305:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767104 00000100:00100000:2.0:1789596772.810364:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767616 00000100:00100000:2.0:1789596772.810368:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767616 00000100:00100000:2.0:1789596772.810395:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767488 00000100:00100000:2.0:1789596772.810399:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767488 00000100:00100000:2.0:1789596772.810419:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789596772.810428:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984767104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.810526:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984767104:12345-0@lo:400:kworker.0 Request processed in 99us (6004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596772.810533:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789596772.810549:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789596772.810556:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984767616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.810583:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984767616:12345-0@lo:400:kworker.0 Request processed in 29us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596772.810589:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789596772.810600:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789596772.810605:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984767488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.810647:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984767488:12345-0@lo:400:kworker.0 Request processed in 42us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596772.810653:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1789596772.810672:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596772.810692:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596772.810709:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984766976 00000100:00100000:2.0:1789596772.810713:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984766976 00000100:00100000:2.0:1789596772.810738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789596772.810744:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984766976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596772.810776:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984766976:12345-0@lo:400:kworker.0 Request processed in 32us (6140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596772.810782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789596772.810900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984766976:0@lo:400:kworker.0 00010000:00080000:0.0:1789596772.810916:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dedf80 x1876527984767488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596772.810927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984767488:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.810939:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984767104:0@lo:400:kworker.0 00000100:00100000:0.0:1789596772.810947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984767616:0@lo:400:kworker.0 00000020:00000004:3.0:1789596773.792023:0:12508:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596773.792314:0:12508:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789596773.821056:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596774.333114:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596774.333141:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984767872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596774.333218:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596774.333349:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984767872 00000100:00100000:1.0:1789596774.333358:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984767872 00000100:00100000:1.0:1789596774.333429:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789596774.333440:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984767872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596774.333475:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596774.333583:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984767872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.333590:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789596774.333865:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984767872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596774.406751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.406817:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620096 00000100:00100000:1.0:1789596774.406830:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620096 00000100:00100000:1.0:1789596774.406890:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 311 00000100:00100000:1.0:1789596774.406904:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961620096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.406981:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961620096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.406989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 311 00000100:00100000:1.0:1789596774.407051:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.407177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.407204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.407225:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.407240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.407260:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596774.407280:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620352 00000100:00100000:1.0:1789596774.407283:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620352 00000100:00100000:1.0:1789596774.407316:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620608 00000100:00100000:1.0:1789596774.407318:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620608 00000100:00100000:1.0:1789596774.407331:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620224 00000100:00100000:1.0:1789596774.407334:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620224 00000100:00100000:1.0:1789596774.407345:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620480 00000100:00100000:1.0:1789596774.407346:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620480 00000100:00100000:1.0:1789596774.407359:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:1.0:1789596774.407364:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961620352:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.407403:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961620352:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.407408:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:1.0:1789596774.407420:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:1.0:1789596774.407426:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.407460:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.407466:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:1.0:1789596774.407480:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:1.0:1789596774.407486:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961620224:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.407507:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961620224:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.407512:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:1.0:1789596774.407522:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:1.0:1789596774.407527:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.407547:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 20us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.407551:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:1.0:1789596774.407569:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620864 00000100:00100000:1.0:1789596774.407572:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620864 00000100:00100000:1.0:1789596774.407595:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620736 00000100:00100000:1.0:1789596774.407597:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620736 00000100:00100000:1.0:1789596774.407615:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:1.0:1789596774.407621:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.407647:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.407653:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:1.0:1789596774.407663:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1789596774.407670:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.407726:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961620736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.407733:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00080000:1.0:1789596774.407758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596774.407761:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596774.407764:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596774.407765:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789596774.846180:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596775.874338:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789596775.980931:0:12606:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789596775.981208:0:12606:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789596776.381674:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596776.381711:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984768000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596776.381781:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596776.381849:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768000 00000100:00100000:1.0:1789596776.381856:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768000 00000100:00100000:1.0:1789596776.381899:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789596776.381909:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984768000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596776.381944:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596776.382002:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984768000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596776.382009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789596776.382137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984768000:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596776.895758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596777.405180:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596777.405202:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984768128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596777.405331:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596777.405404:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768128 00000100:00100000:3.0:1789596777.405413:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768128 00000100:00100000:0.0:1789596777.405465:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984768256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596777.405476:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596777.405493:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596777.405494:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984768128:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596777.405525:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768256 00000100:00100000:0.0:1789596777.405529:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768256 00002000:00000024:3.0:1789596777.405535:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596777.405580:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984768128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596777.405582:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789596777.405586:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596777.405589:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984768256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596777.405599:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789596777.405627:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dec380 x1876527984768128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596777.405627:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984768256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596777.405638:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789596777.405645:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984768128:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789596777.405675:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c16300 x1876527984768256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596777.405709:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984768256:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789596777.405765:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596777.917900:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596777.917922:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984768384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596777.917990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.918067:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768384 00000100:00100000:1.0:1789596777.918075:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768384 00000100:00100000:1.0:1789596777.918135:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789596777.918146:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984768384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596777.918191:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596777.918240:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984768384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.918247:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789596777.918269:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596777.918325:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b7b80 x1876527984768384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596777.918343:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984768384:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789596777.921492:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596777.924467:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924542:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.924583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984769024:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924606:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.924622:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984769536:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924641:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.924660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789596777.924666:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924705:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.924724:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984769152:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924745:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.924761:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984769664:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.924813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768512 00000100:00100000:1.0:1789596777.924822:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768512 00000100:00100000:1.0:1789596777.924869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789596777.924878:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.924942:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984768512:12345-0@lo:400:kworker.0 Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.924950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789596777.924999:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769024 00000100:00100000:1.0:1789596777.925003:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769024 00000100:00100000:1.0:1789596777.925029:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789596777.925035:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984769024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925078:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984769024:12345-0@lo:400:kworker.0 Request processed in 44us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925085:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789596777.925103:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769536 00000100:00100000:1.0:1789596777.925106:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769536 00000100:00100000:1.0:1789596777.925136:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768640 00000100:00100000:1.0:1789596777.925139:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768640 00000100:00100000:1.0:1789596777.925154:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769152 00000100:00100000:1.0:1789596777.925156:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769152 00000100:00100000:1.0:1789596777.925169:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789596777.925175:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925205:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984769536:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925210:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789596777.925221:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789596777.925227:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984768640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925254:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984768640:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925260:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789596777.925270:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789596777.925283:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984769152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925312:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984769152:12345-0@lo:400:kworker.0 Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925317:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789596777.925342:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769664 00000100:00100000:1.0:1789596777.925345:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769664 00000100:00100000:1.0:1789596777.925371:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789596777.925376:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984769664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925402:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984769664:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925407:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789596777.925435:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596777.925438:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596777.925440:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596777.925450:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984768896:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925471:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.925487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984769408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925505:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.925520:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789596777.925525:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984768768:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925544:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.925558:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925578:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.925599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768896 00000100:00100000:1.0:1789596777.925602:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768896 00000100:00100000:1.0:1789596777.925622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769408 00000100:00100000:1.0:1789596777.925624:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769408 00000100:00100000:1.0:1789596777.925655:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769280 00000100:00100000:1.0:1789596777.925658:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769280 00000100:00100000:1.0:1789596777.925672:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789596777.925701:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984768896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925739:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984768896:12345-0@lo:400:kworker.0 Request processed in 62us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925746:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789596777.925758:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789596777.925763:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984769408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925790:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984769408:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925795:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789596777.925806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789596777.925812:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984769280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925836:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984769280:12345-0@lo:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925842:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1789596777.925858:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596777.925860:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596777.925867:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984768768 00000100:00100000:1.0:1789596777.925871:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984768768 00000100:00100000:1.0:1789596777.925889:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789596777.925896:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.925923:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984768768:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.925928:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789596777.925961:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984768768:0@lo:400:kworker.0 00010000:00080000:1.0:1789596777.925983:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d4e00 x1876527984769280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596777.925993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.926001:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984768896:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.926009:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984769408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.926080:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.926091:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984769152:0@lo:400:kworker.0 00010000:00080000:1.0:1789596777.926100:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d7100 x1876527984769664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596777.926109:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984769664:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.926117:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789596777.926125:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984769024:0@lo:400:kworker.0 00010000:00080000:1.0:1789596777.926133:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d7b80 x1876527984769536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596777.926140:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984769536:0@lo:400:kworker.0 00000100:00100000:2.0:1789596777.928635:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596777.928660:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984769792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596777.928754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596777.928895:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769792 00000100:00100000:0.0:1789596777.928903:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769792 00000100:00100000:0.0:1789596777.928966:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789596777.928976:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984769792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596777.928998:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596777.929059:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984769792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596777.929066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1789596777.929112:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c16300 x1876527984769792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596777.929130:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984769792:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1789596778.614996:0:12703:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596778.615528:0:12703:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789596778.940985:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596779.457055:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596779.457078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984769920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596779.457218:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596779.457358:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984769920 00000100:00100000:1.0:1789596779.457367:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984769920 00000100:00100000:1.0:1789596779.457418:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789596779.457428:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984769920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596779.457462:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596779.457510:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984769920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596779.457528:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789596779.457571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984769920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596779.516787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596779.516835:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596779.516873:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596779.516895:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596779.516914:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596779.516933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596779.517217:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621120 00000100:00100000:0.0:1789596779.517227:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621120 00000100:00100000:0.0:1789596779.517290:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621376 00000100:00100000:0.0:1789596779.517293:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621376 00000100:00100000:0.0:1789596779.517308:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621248 00000100:00100000:0.0:1789596779.517310:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621248 00000100:00100000:0.0:1789596779.517322:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621504 00000100:00100000:0.0:1789596779.517325:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621504 00000100:00100000:0.0:1789596779.517340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:0.0:1789596779.517364:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961621120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596779.517455:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961621120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 92us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596779.517463:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:0.0:1789596779.517480:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:0.0:1789596779.517487:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961621376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596779.517513:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961621376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596779.517520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:0.0:1789596779.517531:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:0.0:1789596779.517537:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961621248:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596779.517572:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961621248:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 35us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596779.517578:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:0.0:1789596779.517588:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:0.0:1789596779.517594:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961621504:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596779.517616:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961621504:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596779.517621:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:0.0:1789596779.517665:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621632 00000100:00100000:0.0:1789596779.517669:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621632 00000100:00100000:0.0:1789596779.517729:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789596779.517735:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2405:x1876527961621632:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789596779.517763:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbea38 00000100:00080000:0.0:1789596779.517772:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c18800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789596779.517816:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789596779.517932:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d191948b-51c9-4843-830f-05feb1db7f03+2:2405:x1876527961621632:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 196us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596779.517939:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789596779.517963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961620992 00000100:00100000:0.0:1789596779.517967:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961620992 00000100:00100000:0.0:1789596779.517990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 313 00000100:00100000:0.0:1789596779.517995:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961620992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596779.518016:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961620992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596779.518021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 313 00010000:00010000:0.0:1789596779.518058:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596779.518088:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596779.518092:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596779.518094:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596779.518496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596779.518535:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621760 00000100:00100000:1.0:1789596779.518540:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621760 00000100:00100000:1.0:1789596779.518586:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1789596779.518594:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2405:x1876527961621760:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:1.0:1789596779.518609:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbea3f 00000100:00080000:1.0:1789596779.518616:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c1f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789596779.518645:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789596779.518759:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d191948b-51c9-4843-830f-05feb1db7f03+2:2405:x1876527961621760:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 166us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596779.518766:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00010000:00010000:1.0:1789596779.518784:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789596779.518789:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789596779.965932:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596780.989516:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789596781.392463:0:12800:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596781.394290:0:12800:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789596781.501799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984770048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596781.501882:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596781.502752:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770048 00000100:00100000:0.0:1789596781.502764:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770048 00000100:00100000:0.0:1789596781.502886:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789596781.502897:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984770048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789596781.502934:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789596781.506119:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984770048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3217us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596781.506146:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789596781.509459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984770048:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596782.018722:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596782.525501:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984770176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596782.525609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596782.525700:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770176 00000100:00100000:3.0:1789596782.525708:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770176 00000100:00100000:3.0:1789596782.525765:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789596782.525775:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984770176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596782.525804:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596782.525861:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984770176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596782.525867:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789596782.525888:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596782.525916:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dec380 x1876527984770176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596782.525934:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984770176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596782.526728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984770304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596782.526770:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596782.526902:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770304 00000100:00100000:3.0:1789596782.526908:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770304 00000100:00100000:3.0:1789596782.526970:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789596782.526978:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984770304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596782.526995:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789596782.527059:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596782.542581:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984770304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15594us (15799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596782.542598:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789596782.542916:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8279ad80 x1876527984770304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596782.542942:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984770304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596783.036948:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596783.036972:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984770432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596783.037047:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.037188:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770432 00000100:00100000:3.0:1789596783.037195:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770432 00000100:00100000:3.0:1789596783.037317:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789596783.037327:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984770432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596783.037354:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596783.037525:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984770432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.037533:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1789596783.037558:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789596783.037565:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789596783.037595:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c16a00 x1876527984770432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596783.037615:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984770432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596783.040208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984770688:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.040285:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.040328:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984771200:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.040350:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596783.040700:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984770944:0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.040714:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984770560:0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.040747:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596783.040790:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984771072:0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.040816:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596783.040854:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984771584:0@lo:400:kworker.0 00000100:00100000:2.0:1789596783.040896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771072 00000100:00100000:2.0:1789596783.040906:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771072 00000100:00100000:2.0:1789596783.040959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789596783.040967:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984771072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596783.041212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770560 00000100:00100000:0.0:1789596783.041218:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770560 00000100:00100000:0.0:1789596783.041249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789596783.041256:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984770560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.042610:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596783.049815:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984771072:12345-0@lo:400:kworker.0 Request processed in 8836us (8986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.049831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789596783.049925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984771072:0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.049928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770688 00000100:00100000:1.0:1789596783.049938:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770688 00000100:00100000:1.0:1789596783.049989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771200 00000100:00100000:1.0:1789596783.049992:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771200 00000100:00100000:1.0:1789596783.050030:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771584 00000100:00100000:1.0:1789596783.050033:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771584 00000100:00100000:1.0:1789596783.050048:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789596783.050936:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984770688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.051185:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984770688:12345-0@lo:400:kworker.0 Request processed in 1130us (10900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596783.051193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789596783.051219:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789596783.051227:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984771200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.051257:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984771200:12345-0@lo:400:kworker.0 Request processed in 32us (10906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596783.051262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789596783.051273:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789596783.051353:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984771584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596783.051398:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984771584:12345-0@lo:400:kworker.0 Request processed in 49us (8799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596783.051405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00080000:1.0:1789596783.051463:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb98d5500 x1876527984771584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596783.051497:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984771584:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.061954:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984771200:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.061973:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984771712:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062036:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.062088:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984770688:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062161:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771712 00000100:00100000:3.0:1789596783.062168:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771712 00000100:00100000:3.0:1789596783.062216:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596783.062223:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984771712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062270:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984771712:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.062276:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789596783.062298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596783.062302:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596783.062305:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596783.062316:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.062341:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984771456:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.062391:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789596783.062398:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984770816:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062423:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.062597:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984771328:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062620:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.062633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984771840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596783.062652:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596783.062675:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770944 00000100:00100000:3.0:1789596783.062701:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770944 00000100:00100000:3.0:1789596783.062738:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771456 00000100:00100000:3.0:1789596783.062741:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771456 00000100:00100000:3.0:1789596783.062761:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771328 00000100:00100000:3.0:1789596783.062764:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771328 00000100:00100000:3.0:1789596783.062779:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789596783.062786:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984770944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062824:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984770944:12345-0@lo:400:kworker.0 Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.062830:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789596783.062842:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789596783.062847:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984771456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062873:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984771456:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.062879:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789596783.062889:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789596783.062894:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984771328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.062917:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984771328:12345-0@lo:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.062923:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789596783.062928:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984770560:12345-0@lo:400:kworker.0 Request processed in 21671us (22178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596783.062937:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789596783.062938:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984770816 00000100:00100000:3.0:1789596783.062941:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984770816 00000100:00100000:3.0:1789596783.062962:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789596783.062968:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984770816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596783.062969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984770560:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.063012:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984770816:12345-0@lo:400:kworker.0 Request processed in 44us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.063017:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789596783.063036:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771840 00000100:00100000:3.0:1789596783.063045:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771840 00000100:00100000:3.0:1789596783.063079:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789596783.063085:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984771840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596783.063099:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596783.066579:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984771840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3481us (3913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.066597:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789596783.066671:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596783.066694:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596783.066746:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984770816:0@lo:400:kworker.0 00010000:00080000:3.0:1789596783.066768:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5880 x1876527984771328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596783.066778:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984771328:0@lo:400:kworker.0 00010000:00080000:3.0:1789596783.066792:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c16a00 x1876527984771840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596783.066815:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984771840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596783.066830:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984770944:0@lo:400:kworker.0 00000100:00100000:3.0:1789596783.066842:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984771456:0@lo:400:kworker.0 00010000:00080000:3.0:1789596783.066898:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb98d7480 x1876527984771712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596783.066907:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984771712:0@lo:400:kworker.0 00010000:00010000:0.0:1789596784.064745:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789596784.337170:0:12898:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596784.337454:0:12898:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789596784.581152:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984771968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596784.581260:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596784.581369:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984771968 00000100:00100000:1.0:1789596784.581379:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984771968 00000100:00100000:1.0:1789596784.581439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789596784.581450:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984771968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596784.581498:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596784.583186:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984771968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1726us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596784.583200:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789596784.583290:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984771968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596784.633114:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596784.633162:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596784.633172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961621888 00000100:00100000:1.0:1789596784.633190:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596784.633206:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961621888 00000100:00100000:1.0:1789596784.633213:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596784.633243:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596784.633263:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 315 00000100:00100000:3.0:1789596784.633276:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961621888:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596784.633364:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961621888:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.633373:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 315 00000100:00100000:3.0:1789596784.633411:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622144 00000100:00100000:3.0:1789596784.633415:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622144 00000100:00100000:3.0:1789596784.633453:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622400 00000100:00100000:3.0:1789596784.633457:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622400 00000100:00100000:3.0:1789596784.633476:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622016 00000100:00100000:3.0:1789596784.633479:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622016 00000100:00100000:3.0:1789596784.633492:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622272 00000100:00100000:3.0:1789596784.633495:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622272 00000100:00100000:3.0:1789596784.633509:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:3.0:1789596784.633514:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961622144:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596784.633556:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961622144:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.633562:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:3.0:1789596784.633577:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:3.0:1789596784.633585:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961622400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596784.633616:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961622400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.633622:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:3.0:1789596784.633639:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:3.0:1789596784.633648:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961622016:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596784.633713:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961622016:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 66us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.633720:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:3.0:1789596784.633733:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:3.0:1789596784.633741:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961622272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596784.633768:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961622272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.633775:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00080000:3.0:1789596784.633823:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596784.633828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1789596785.091750:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000020:00000080:3.0:1789596785.091761:0:8430:0:(genops.c:885:class_export_put()) final put ffff9c7d83c1e000/d191948b-51c9-4843-830f-05feb1db7f03 00000020:00000080:0.0:1789596785.091866:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c1e000/d191948b-51c9-4843-830f-05feb1db7f03 for lustre-OST0000 00000020:00000080:0.0:1789596785.091931:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c18800 for lustre-OST0000 00000001:00100000:2.0:1789596785.092714:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000020:00000080:2.0:1789596785.092721:0:9514:0:(genops.c:885:class_export_put()) final put ffff9c7d83c19000/d191948b-51c9-4843-830f-05feb1db7f03 00000020:00000080:3.0:1789596785.092784:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c19000/d191948b-51c9-4843-830f-05feb1db7f03 for lustre-OST0001 00000020:00000080:3.0:1789596785.092841:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c1f800 for lustre-OST0001 00010000:00010000:1.0:1789596785.097284:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596786.109195:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596786.625388:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596786.625417:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984772096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596786.625756:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596786.625870:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772096 00000100:00100000:2.0:1789596786.625880:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772096 00000100:00100000:2.0:1789596786.625958:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789596786.625977:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984772096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789596786.626011:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789596786.626065:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984772096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596786.626667:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789596786.626760:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984772096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596787.133823:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596787.645447:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596787.645473:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984772352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596787.645567:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596787.645656:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772352 00000100:00100000:3.0:1789596787.645665:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772352 00000100:00100000:3.0:1789596787.645745:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789596787.645756:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984772352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596787.645791:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596787.645858:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984772352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.645865:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789596787.646058:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596787.646190:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83728380 x1876527984772352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596787.646212:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984772352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596787.646498:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596787.646513:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984772224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596787.646563:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596787.646610:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772224 00000100:00100000:0.0:1789596787.646615:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772224 00000100:00100000:0.0:1789596787.646658:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596787.646665:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984772224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596787.646714:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596787.646752:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984772224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596787.646759:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1789596787.646785:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d6d80 x1876527984772224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596787.646799:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984772224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789596787.646992:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596788.157326:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596788.157350:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984772480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596788.157434:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596788.157521:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772480 00000100:00100000:3.0:1789596788.157529:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772480 00000100:00100000:3.0:1789596788.157586:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789596788.157597:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984772480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596788.157630:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596788.157700:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984772480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596788.157709:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:2.0:1789596788.157885:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1789596788.164562:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83728380 x1876527984772480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596788.164590:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984772480:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789596788.164651:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596788.169306:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984772608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596788.169394:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.169627:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772608 00000100:00100000:0.0:1789596788.169638:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772608 00000100:00100000:0.0:1789596788.169725:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789596788.169735:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984772608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596788.169770:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596788.169819:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984772608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.169827:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789596788.169869:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c16a00 x1876527984772608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596788.169888:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984772608:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789596788.170075:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596788.170280:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984772864:0@lo:400:kworker.0 00000100:00100000:2.0:1789596788.170315:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.170560:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596788.170570:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984772736:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.170604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.170638:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772736 00000100:00100000:0.0:1789596788.170642:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772736 00000100:00100000:0.0:1789596788.170672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789596788.170695:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984772736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.170744:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984772736:12345-0@lo:400:kworker.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.170751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789596788.170803:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984772736:0@lo:400:kworker.0 00000100:00100000:3.0:1789596788.170941:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772864 00000100:00100000:3.0:1789596788.170946:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772864 00000100:00100000:3.0:1789596788.170997:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789596788.171004:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984772864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.171144:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984772992:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.171175:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.171206:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984772992 00000100:00100000:0.0:1789596788.171209:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984772992 00000100:00100000:0.0:1789596788.171236:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789596788.171242:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984772992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.171275:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984772992:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.171282:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789596788.171305:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984772992:0@lo:400:kworker.0 00000100:00100000:3.0:1789596788.175871:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984772864:12345-0@lo:400:kworker.0 Request processed in 4857us (5544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596788.175905:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789596788.181176:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984773504:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.181252:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.181302:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596788.181308:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984773376:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.181331:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.181369:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984773120:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.181392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.181407:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984773632:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.181426:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.181444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789596788.181469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984773248:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.181513:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.181532:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984773760:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.181552:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.181580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773504 00000100:00100000:0.0:1789596788.181588:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773504 00000100:00100000:0.0:1789596788.181651:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773376 00000100:00100000:0.0:1789596788.181654:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773376 00000100:00100000:0.0:1789596788.181668:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773120 00000100:00100000:0.0:1789596788.181670:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773120 00000100:00100000:0.0:1789596788.181710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773632 00000100:00100000:0.0:1789596788.181713:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773632 00000100:00100000:0.0:1789596788.181727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773760 00000100:00100000:0.0:1789596788.181729:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773760 00000100:00100000:0.0:1789596788.182030:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789596788.182041:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984773504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182104:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984773504:12345-0@lo:400:kworker.0 Request processed in 66us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.182123:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789596788.182144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789596788.182150:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984773376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182178:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984773376:12345-0@lo:400:kworker.0 Request processed in 29us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.182183:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789596788.182194:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789596788.182199:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984773120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182229:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984773120:12345-0@lo:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.182248:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789596788.182261:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789596788.182266:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984773632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182296:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984773632:12345-0@lo:400:kworker.0 Request processed in 30us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.182302:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789596788.182313:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789596788.182319:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984773760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182341:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984773760:12345-0@lo:400:kworker.0 Request processed in 23us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.182345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789596788.182537:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773248 00000100:00100000:0.0:1789596788.182542:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773248 00000100:00100000:0.0:1789596788.182570:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789596788.182576:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984773248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182610:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984773248:12345-0@lo:400:kworker.0 Request processed in 33us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.182616:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789596788.182664:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984773376:0@lo:400:kworker.0 00010000:00080000:0.0:1789596788.182705:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d831b6680 x1876527984773504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596788.182716:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984773504:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182753:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984773248:0@lo:400:kworker.0 00010000:00080000:0.0:1789596788.182762:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f7100 x1876527984773760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596788.182779:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984773760:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182791:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984773120:0@lo:400:kworker.0 00000100:00100000:0.0:1789596788.182799:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984773632:0@lo:400:kworker.0 00000100:00080000:0.0:1789596788.182842:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596788.182847:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596788.186328:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984772864:0@lo:400:kworker.0 00010000:00010000:0.0:1789596789.186142:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596789.315088:0:13043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789596789.694705:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596789.694730:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984773888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596789.694853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596789.695100:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984773888 00000100:00100000:1.0:1789596789.695120:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984773888 00000100:00100000:1.0:1789596789.695179:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789596789.695197:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984773888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596789.695254:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596789.695315:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984773888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596789.695323:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789596789.695491:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984773888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596789.752003:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596789.752046:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596789.752078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596789.752121:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596789.752152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596789.752184:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622656 00000100:00100000:1.0:1789596789.752196:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622656 00000100:00100000:1.0:1789596789.752270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622912 00000100:00100000:1.0:1789596789.752273:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622912 00000100:00100000:1.0:1789596789.752289:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622784 00000100:00100000:1.0:1789596789.752291:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622784 00000100:00100000:1.0:1789596789.752303:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623040 00000100:00100000:1.0:1789596789.752305:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623040 00000100:00100000:1.0:1789596789.752321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00100000:1.0:1789596789.752331:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961622656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596789.752510:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961622528 00000100:00100000:2.0:1789596789.752515:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961622528 00000100:00100000:2.0:1789596789.752550:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 317 00000100:00100000:2.0:1789596789.752558:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961622528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596789.752628:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961622528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 70us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596789.752636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 317 00000100:00100000:2.0:1789596789.752820:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:2.0:1789596789.752829:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961622912:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596789.752863:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961622912:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596789.752871:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:2.0:1789596789.752886:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:2.0:1789596789.752892:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961622784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596789.752915:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961622784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596789.752920:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:2.0:1789596789.752930:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:2.0:1789596789.752948:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961623040:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596789.752992:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961623040:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596789.752998:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:1.0:1789596789.753616:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961622656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1282us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596789.753625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00080000:0.0:1789596789.753706:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596789.753712:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789596790.204906:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596791.253040:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596791.746828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984774016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596791.746903:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596791.747230:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774016 00000100:00100000:3.0:1789596791.747241:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774016 00000100:00100000:3.0:1789596791.747293:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789596791.747303:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984774016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596791.747340:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596791.747399:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984774016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596791.747406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789596791.747504:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984774016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596792.256422:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596792.768100:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984774144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596792.768209:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.768278:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596792.768284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984774272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596792.768309:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.768347:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774144 00000100:00100000:1.0:1789596792.768355:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774144 00000100:00100000:1.0:1789596792.768416:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774272 00000100:00100000:1.0:1789596792.768420:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774272 00000100:00100000:1.0:1789596792.768439:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789596792.768447:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984774144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596792.768477:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596792.768520:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984774144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.768528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789596792.768544:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789596792.768549:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984774272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596792.768559:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596792.768582:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984774272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.768587:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789596792.768606:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596792.768633:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f5180 x1876527984774272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596792.768652:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984774272:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789596792.768664:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f7800 x1876527984774144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596792.768674:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984774144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596793.277764:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984774400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596793.277850:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596793.277938:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774400 00000100:00100000:1.0:1789596793.277947:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774400 00000100:00100000:1.0:1789596793.277998:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596793.278008:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984774400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596793.278048:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596793.278095:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984774400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596793.278102:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789596793.278124:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596793.278167:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f7800 x1876527984774400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596793.278188:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984774400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596793.278725:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984774656:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.278766:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.278788:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984775168:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.278808:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.278830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984775680:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.278851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.278877:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789596793.278882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984774784:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.278916:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.278934:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984775296:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.278966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.278980:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984775808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.278999:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.279042:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774656 00000100:00100000:2.0:1789596793.279047:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774656 00000100:00100000:2.0:1789596793.279075:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775168 00000100:00100000:2.0:1789596793.279077:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775168 00000100:00100000:2.0:1789596793.279099:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775680 00000100:00100000:2.0:1789596793.279101:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775680 00000100:00100000:2.0:1789596793.279114:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775296 00000100:00100000:2.0:1789596793.279116:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775296 00000100:00100000:2.0:1789596793.279128:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775808 00000100:00100000:2.0:1789596793.279130:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775808 00000100:00100000:2.0:1789596793.279155:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789596793.279178:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984774656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279222:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984774656:12345-0@lo:400:kworker.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.279413:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789596793.279433:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789596793.279440:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984775168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279471:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984775168:12345-0@lo:400:kworker.0 Request processed in 32us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.279477:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789596793.279489:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789596793.279495:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984775680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279522:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984775680:12345-0@lo:400:kworker.0 Request processed in 28us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.279528:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789596793.279539:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789596793.279545:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984775296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279570:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984775296:12345-0@lo:400:kworker.0 Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.279575:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789596793.279585:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789596793.279590:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984775808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279616:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984775808:12345-0@lo:400:kworker.0 Request processed in 25us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.279622:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789596793.279651:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774784 00000100:00100000:2.0:1789596793.279663:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774784 00000100:00100000:2.0:1789596793.279732:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789596793.279739:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984774784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279774:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984774784:12345-0@lo:400:kworker.0 Request processed in 36us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.279780:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1789596793.279802:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596793.279807:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596793.279819:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984774912:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279843:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.279863:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984775424:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.279913:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984775936:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279935:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.279955:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789596793.279960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984774528:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.279983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.280005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984775040:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.281379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.281423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984775552:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.281461:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.281506:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775424 00000100:00100000:2.0:1789596793.281513:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775424 00000100:00100000:2.0:1789596793.281558:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775936 00000100:00100000:2.0:1789596793.281561:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775936 00000100:00100000:2.0:1789596793.281582:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775552 00000100:00100000:2.0:1789596793.281585:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775552 00000100:00100000:2.0:1789596793.281617:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789596793.281624:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984775424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.281675:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984775424:12345-0@lo:400:kworker.0 Request processed in 51us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.281697:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789596793.281714:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789596793.281720:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984775936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.281751:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984775936:12345-0@lo:400:kworker.0 Request processed in 30us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.281756:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789596793.281766:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596793.281771:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.281797:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984775552:12345-0@lo:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.281802:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596793.281839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774528 00000100:00100000:2.0:1789596793.281843:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774528 00000100:00100000:2.0:1789596793.281869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789596793.281875:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984774528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.281918:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984774528:12345-0@lo:400:kworker.0 Request processed in 43us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.281924:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:2.0:1789596793.281970:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596793.281980:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984775040 00000100:00100000:2.0:1789596793.281983:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984775040 00000100:00100000:2.0:1789596793.282006:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789596793.282011:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984775040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596793.283205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984774912 00000100:00100000:1.0:1789596793.283217:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984774912 00000100:00100000:1.0:1789596793.283284:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789596793.283292:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984774912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596793.283362:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984774912:12345-0@lo:400:kworker.0 Request processed in 71us (3517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596793.283368:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789596793.283991:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984775040:12345-0@lo:400:kworker.0 Request processed in 1978us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.284001:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789596793.284355:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984774784:0@lo:400:kworker.0 00010000:00080000:2.0:1789596793.284373:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212a00 x1876527984775296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596793.284384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984775296:0@lo:400:kworker.0 00010000:00080000:2.0:1789596793.284395:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212300 x1876527984775808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596793.284404:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984775808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.284417:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984774656:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.284429:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984775168:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.284440:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984775680:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.284492:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984774528:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.284503:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984775040:0@lo:400:kworker.0 00010000:00080000:2.0:1789596793.284514:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb211180 x1876527984775552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596793.284522:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984775552:0@lo:400:kworker.0 00000100:00100000:2.0:1789596793.284533:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984774912:0@lo:400:kworker.0 00010000:00080000:2.0:1789596793.284543:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212680 x1876527984775424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596793.284569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984775424:0@lo:400:kworker.0 00010000:00080000:2.0:1789596793.284583:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212d80 x1876527984775936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596793.284592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984775936:0@lo:400:kworker.0 00010000:00010000:1.0:1789596793.287498:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596793.289826:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984776064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596793.289895:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596793.292741:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776064 00000100:00100000:2.0:1789596793.292759:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776064 00000100:00100000:2.0:1789596793.292813:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789596793.292823:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984776064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789596793.292850:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596793.293577:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984776064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 751us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596793.293587:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1789596793.305593:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd0000 x1876527984776064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596793.305630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984776064:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789596794.005291:0:13190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb0cd2600 20000000:00000080:1.0:1789596794.005311:0:13190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7d820ad400 uarg=0000000000000000 20000000:01000000:1.0:1789596794.005363:0:13190:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789596794.005370:0:13190:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789596794.005375:0:13190:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789596794.006137:0:13191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789596794.006313:0:13190:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789596794.012348:0:13190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789596794.012384:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012404:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012414:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012488:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012496:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012503:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012510:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012517:0:13190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012565:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.012604:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 12 pid: 6514 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.012621:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776192:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596794.013003:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013013:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.013024:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776320:0@lo:104: 00000100:00100000:1.0:1789596794.013096:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596794.013139:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776320 00000100:00100000:1.0:1789596794.013148:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776320 00000100:00100000:1.0:1789596794.013199:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789596794.013208:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776320:12345-0@lo:104: 00010000:00010000:1.0:1789596794.013222:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013272:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596794.013278:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776320:12345-0@lo:104: Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596794.013284:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1789596794.013322:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013330:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 23 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.013346:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776448:0@lo:104: 00000100:00100000:1.0:1789596794.013371:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596794.013391:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776448 00000100:00100000:1.0:1789596794.013395:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776448 00000100:00100000:1.0:1789596794.013411:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596794.013418:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776448:12345-0@lo:104: 00010000:00010000:1.0:1789596794.013440:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013476:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789596794.013482:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776448:12345-0@lo:104: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596794.013488:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789596794.013504:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789596794.013509:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013516:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596794.013520:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013529:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596794.013536:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596794.013543:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789596794.013579:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013586:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596794.013606:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013613:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6600/0x7b5398e289bbea07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013627:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596794.013630:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013636:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596794.013638:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013645:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596794.013652:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596794.013657:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789596794.013671:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013711:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596794.013717:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013734:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbe9f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013743:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596794.013745:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596794.013747:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596794.013766:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.013773:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 23 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.013782:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776832:0@lo:104: 00000100:00100000:1.0:1789596794.013804:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596794.014135:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776832 00000100:00100000:1.0:1789596794.014140:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776832 00000100:00100000:1.0:1789596794.014162:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789596794.014169:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776832:12345-0@lo:104: 00010000:00010000:1.0:1789596794.014177:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.014224:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789596794.014230:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776832:12345-0@lo:104: Request processed in 62us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596794.014235:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789596794.014263:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.014284:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 23 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.014292:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776960:0@lo:104: 00000100:00100000:1.0:1789596794.014316:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596794.014337:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776960 00000100:00100000:1.0:1789596794.014340:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776960 00000100:00100000:1.0:1789596794.014356:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789596794.014361:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776960:12345-0@lo:104: 00010000:00010000:1.0:1789596794.014369:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.014399:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789596794.014404:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d576172c-8178-43f9-add9-c496dd76058d+3:13190:x1876527984776960:12345-0@lo:104: Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596794.014410:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789596794.014638:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596794.014645:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014652:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596794.014655:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014662:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596794.014668:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596794.014674:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596794.014718:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014724:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596794.014750:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014757:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbe9eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe9f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014768:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596794.014771:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014777:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ec2052e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596794.014780:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.014786:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596794.014792:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596794.014798:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596794.014813:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015066:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596794.015075:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015082:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbe9dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbe9e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015096:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596794.015104:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596794.015106:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596794.015123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984777088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596794.015159:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596794.015187:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596794.015193:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984777216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596794.015215:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596794.015249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777088 00000100:00100000:3.0:1789596794.015255:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777088 00010000:00010000:3.0:1789596794.015277:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 24 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596794.015297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777216 00000100:00100000:3.0:1789596794.015300:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777216 00010000:00010000:3.0:1789596794.015312:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 25 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596794.015329:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789596794.015337:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+25:3644:x1876527984777088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596794.015349:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596794.015354:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 25 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015364:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 25 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015381:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596794.015409:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+25:3644:x1876527984777088:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596794.015415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789596794.015531:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596794.015597:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789596794.015604:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984777216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596794.015614:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596794.015619:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 24 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015626:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 24 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.015635:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596794.015656:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984777216:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596794.015661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789596794.015775:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596794.015786:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 12 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596794.015797:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984777344:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596794.015867:0:13190:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596794.015889:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776320:0@lo:104: 00000100:00100000:0.0:1789596794.015913:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776448:0@lo:104: 00010000:00010000:0.0:1789596794.015923:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7600/0x7b5398e289bbe9f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe9eb expref: 23 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596794.015934:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776832:0@lo:104: 00010000:00010000:0.0:1789596794.015943:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7c00/0x7b5398e289bbe9e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe9dd expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596794.015950:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776960:0@lo:104: 00000100:00100000:3.0:1789596794.016069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984777216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596794.016078:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984777088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596794.016271:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596794.016324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984776576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596794.016355:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596794.016384:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596794.016390:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984776704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596794.016412:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596794.017369:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776576 00000100:00100000:1.0:1789596794.017378:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776576 00010000:00010000:1.0:1789596794.017413:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 22 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.017502:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984776704 00000100:00100000:1.0:1789596794.017505:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984776704 00010000:00010000:1.0:1789596794.017518:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 23 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596794.017909:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596794.017921:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984776576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596794.017935:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596794.017941:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596794.017952:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596794.017968:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbea0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbea07 expref: 23 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596794.017981:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596794.018050:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3646:x1876527984776576:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596794.018057:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596794.018076:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596794.018083:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+21:3646:x1876527984776704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596794.018096:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596794.018101:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 21 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596794.018108:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 21 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596794.018118:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6200/0x7b5398e289bbea00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbe9f9 expref: 21 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596794.018126:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596794.018149:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+20:3646:x1876527984776704:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596794.018154:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596794.018188:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984776704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596794.018199:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984776576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596794.021801:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596794.021834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596794.021989:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623296 00000100:00100000:1.0:1789596794.021999:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623296 00010000:00010000:1.0:1789596794.022051:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 13 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596794.022091:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623168 00000100:00100000:1.0:1789596794.022095:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623168 00000100:00100000:3.0:1789596794.022107:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00010000:00010000:1.0:1789596794.022109:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 14 pid: 6514 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596794.022118:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454a6744-d65e-403d-97e2-e8496b673d4c+14:2408:x1876527961623296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789596794.022129:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:1.0:1789596794.022134:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e9184b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+14:2408:x1876527961623168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596794.022144:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596794.022144:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596794.022149:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 14 pid: 6514 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.022150:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 14 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.022161:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 14 pid: 6514 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596794.022273:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984776192:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596794.022285:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876527984777344:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596794.023582:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 14 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.023606:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6800/0x7b5398e289bbe9d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077ee expref: 14 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.023761:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596794.023832:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961623296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1715us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596794.023883:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00010000:00010000:1.0:1789596794.029909:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742c00/0x7b5398e289bbea23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0782d expref: 12 pid: 6514 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.029937:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.029947:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.029968:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.029975:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.030003:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.030011:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.030018:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596794.030022:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.030030:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.030040:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596794.030052:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596794.030126:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e9184b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+11:2408:x1876527961623168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7988us (8288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596794.030138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00010000:00010000:0.0:1789596794.030518:0:13190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596794.030531:0:13190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596794.030537:0:13190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596794.030555:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671200/0x7b5398e289bbea46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596794.301015:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596794.813113:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984777472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596794.813270:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596794.813399:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777472 00000100:00100000:0.0:1789596794.813410:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777472 00000100:00100000:0.0:1789596794.813476:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596794.813488:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984777472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789596794.813530:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596794.813648:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984777472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596794.813655:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789596794.813760:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984777472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596794.871754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596794.871804:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596794.871853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596794.871940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623424 00000100:00100000:0.0:1789596794.871952:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623424 00000100:00100000:0.0:1789596794.872008:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 319 00000100:00100000:0.0:1789596794.872019:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+11:2409:x1876527961623424:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596794.872239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596794.872275:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+11:2409:x1876527961623424:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 257us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596794.872284:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 319 00000100:00100000:2.0:1789596794.884736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596794.886203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623680 00000100:00100000:3.0:1789596794.886218:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623680 00000100:00100000:3.0:1789596794.886292:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623936 00000100:00100000:3.0:1789596794.886295:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623936 00000100:00100000:3.0:1789596794.886317:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623552 00000100:00100000:3.0:1789596794.886320:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623552 00000100:00100000:3.0:1789596794.886339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:3.0:1789596794.886349:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961623680:12345-192.168.202.16@tcp:400:kworker.0 00000100:00080000:2.0:1789596794.887476:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596794.887483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596794.887525:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961623808 00000100:00100000:2.0:1789596794.887533:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961623808 00000100:00100000:2.0:1789596794.887579:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:2.0:1789596794.887588:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961623936:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596794.892015:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961623680:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 515us (15058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596794.892048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:3.0:1789596794.892090:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:3.0:1789596794.892105:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961623552:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596794.893298:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961623936:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 5697us (21431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596794.893312:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:2.0:1789596794.893350:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:2.0:1789596794.893363:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961623808:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596794.897594:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961623552:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 5479us (25339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596794.897612:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00080000:1.0:1789596794.897975:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596794.899435:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961623808:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 6065us (14699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596794.899451:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:2.0:1789596795.256891:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596795.257018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624064 00000100:00100000:0.0:1789596795.257031:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624064 00000100:00100000:0.0:1789596795.257244:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:0.0:1789596795.257259:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+11:6180:x1876527961624064:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596795.257282:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596795.257306:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0785e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596795.257353:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596795.257365:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596795.257376:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743800, rc 0) 00000100:00100000:0.0:1789596795.257456:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961624064:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 201us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596795.257464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:0.0:1789596795.268139:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596795.268222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624192 00000100:00100000:1.0:1789596795.268235:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624192 00000100:00100000:1.0:1789596795.268300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:1.0:1789596795.268312:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961624192:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.268519:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961624192:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 208us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.268539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:1.0:1789596795.271986:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596795.276594:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624320 00000100:00100000:0.0:1789596795.276613:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624320 00000100:00100000:0.0:1789596795.276721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 322 00000100:00100000:0.0:1789596795.276733:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961624320:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596795.276931:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961624320:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 199us (4954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596795.276939:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 322 00000100:00100000:3.0:1789596795.287614:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596795.289756:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624448 00000100:00100000:0.0:1789596795.289774:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624448 00000100:00100000:0.0:1789596795.289842:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 323 00000100:00100000:0.0:1789596795.289854:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961624448:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596795.289871:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596795.289903:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07865 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596795.289953:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596795.289966:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596795.289976:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596795.290055:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961624448:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 203us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596795.290061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 323 00000100:00100000:3.0:1789596795.294459:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596795.294588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624576 00000100:00100000:1.0:1789596795.294600:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624576 00000100:00100000:1.0:1789596795.294715:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 324 00000100:00100000:1.0:1789596795.294728:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961624576:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.294913:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961624576:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 188us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.294920:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 324 00000100:00100000:3.0:1789596795.298135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596795.298331:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624704 00000100:00100000:1.0:1789596795.298345:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624704 00000100:00100000:1.0:1789596795.298419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 325 00000100:00100000:1.0:1789596795.298430:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961624704:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.298908:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961624704:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 478us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.298917:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 325 00010000:00010000:1.0:1789596795.324956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789596795.452983:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789596795.452992:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebb0f4000 from 7 10000000:01000000:3.0:1789596795.452998:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596795.453059:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.453072:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.453085:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596795.453116:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.453187:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596795.453243:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596795.453743:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777600 00000100:00100000:1.0:1789596795.453752:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777600 00000100:00100000:1.0:1789596795.453813:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789596795.453824:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984777600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596795.453838:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596795.453854:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbea5b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.453889:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.453928:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.453938:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671400, rc 0) 00000100:00100000:1.0:1789596795.453988:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984777600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.453995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789596795.454099:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596795.454116:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.454125:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596795.454189:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.454218:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596795.454248:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596795.454304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777728 00000100:00100000:1.0:1789596795.454309:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777728 00000100:00100000:1.0:1789596795.454343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789596795.454351:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984777728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.454494:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984777728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.454502:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789596795.454573:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.454599:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.454639:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596795.454703:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596795.454939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777856 00000100:00100000:1.0:1789596795.454945:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777856 00000100:00100000:1.0:1789596795.454982:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789596795.454989:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984777856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.455080:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984777856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.455087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789596795.455173:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789596795.456320:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789596795.456850:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789596795.456876:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596795.456899:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.456929:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596795.456939:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596795.456941:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebaf79000 from 7 10000000:01000000:1.0:1789596795.456944:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596795.456980:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.456988:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.456998:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596795.457023:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.457083:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.457114:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.457303:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984777984 00000100:00100000:3.0:1789596795.457310:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984777984 00000100:00100000:3.0:1789596795.457488:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789596795.457498:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984777984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596795.457513:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596795.457526:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbea69 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.457549:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.457561:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.457569:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:3.0:1789596795.457607:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984777984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.457615:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789596795.457988:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984777984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596795.458004:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.458016:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596795.458081:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.458111:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.458141:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.462039:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778112 00000100:00100000:3.0:1789596795.462058:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778112 00000100:00100000:3.0:1789596795.462131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789596795.462141:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984778112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.462309:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984778112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (4196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.462316:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789596795.462702:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.462756:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.462808:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.462834:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.462957:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778240 00000100:00100000:3.0:1789596795.462963:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778240 00000100:00100000:3.0:1789596795.462998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789596795.463005:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984778240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.463095:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984778240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.463103:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789596795.463180:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789596795.464111:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789596795.464385:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789596795.464422:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596795.464433:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.464446:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596795.464459:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789596795.464462:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb9a66000 from 7 10000000:01000000:3.0:1789596795.464465:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596795.464502:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.464511:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.464522:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596795.464544:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.464605:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596795.464633:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596795.464950:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778368 00000100:00100000:1.0:1789596795.464957:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778368 00000100:00100000:1.0:1789596795.465005:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789596795.465013:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984778368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596795.465026:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596795.465039:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbea77 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.465065:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.465077:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.465087:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671000, rc 0) 00000100:00100000:1.0:1789596795.465131:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984778368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.465138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789596795.465181:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596795.465194:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.465213:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596795.465267:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.465293:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.465307:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda540 going to sleep for 11 seconds 00000100:00100000:1.0:1789596795.465319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778496 00000100:00100000:1.0:1789596795.465323:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778496 00000100:00100000:1.0:1789596795.465343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789596795.465349:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984778496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.467217:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984778496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1857us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.467231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789596795.469852:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596795.470212:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596795.470299:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596795.470391:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.474605:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778624 00000100:00100000:3.0:1789596795.474627:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778624 00000100:00100000:3.0:1789596795.474923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789596795.474936:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984778624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.475142:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984778624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.475150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789596795.478988:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789596795.480187:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789596795.489007:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789596795.489044:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596795.489057:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.489071:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596795.489892:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596795.489897:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e867d5800 from 7 10000000:01000000:1.0:1789596795.489901:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596795.489950:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.489960:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.489988:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596795.490024:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.490105:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.490153:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.490212:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778752 00000100:00100000:3.0:1789596795.490227:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778752 00000100:00100000:3.0:1789596795.490294:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789596795.490305:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984778752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596795.490318:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596795.490340:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbea85 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.490373:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.490391:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596795.490401:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789596795.490464:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984778752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.490471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789596795.490627:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596795.490650:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.490669:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596795.490756:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.490783:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.490801:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.490939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984778880 00000100:00100000:3.0:1789596795.490944:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984778880 00000100:00100000:3.0:1789596795.490982:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789596795.490989:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984778880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.491093:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984778880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.491100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789596795.491174:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984778880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.491201:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984779008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596795.491243:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596795.491266:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596795.491317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779008 00000100:00100000:3.0:1789596795.491321:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779008 00000100:00100000:3.0:1789596795.491351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789596795.491358:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984779008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596795.491435:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984779008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.491442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789596795.491639:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984779008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789596795.493020:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789596795.493340:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789596795.493363:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596795.493374:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596795.493400:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596796.349510:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596796.864114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984779136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596796.864181:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596796.864262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779136 00000100:00100000:0.0:1789596796.864270:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779136 00000100:00100000:0.0:1789596796.864334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596796.864345:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984779136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789596796.864380:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789596796.864437:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984779136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596796.864443:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789596796.864754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984779136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596797.377330:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596797.884948:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984779264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596797.885025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596797.885119:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779264 00000100:00100000:1.0:1789596797.885127:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779264 00000100:00100000:1.0:1789596797.885203:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789596797.885213:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984779264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596797.885244:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596797.885291:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984779264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596797.885297:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1789596797.885318:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596797.885349:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836cb480 x1876527984779264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596797.885367:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984779264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596797.886347:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596797.886363:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984779392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596797.886413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596797.886504:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779392 00000100:00100000:2.0:1789596797.886512:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779392 00000100:00100000:2.0:1789596797.886639:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789596797.886649:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984779392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596797.886669:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596797.886754:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984779392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596797.886760:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1789596797.886806:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd1f80 x1876527984779392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596797.886823:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984779392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596797.886994:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596798.397696:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596798.397720:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984779520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596798.397788:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.397867:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779520 00000100:00100000:1.0:1789596798.397875:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779520 00000100:00100000:1.0:1789596798.397933:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789596798.397944:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984779520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596798.398000:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596798.398048:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984779520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.398055:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789596798.398076:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596798.398107:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836cb480 x1876527984779520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596798.398127:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984779520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596798.398566:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596798.398576:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984779648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596798.398608:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596798.398791:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984780032:0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.398822:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596798.398851:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984780544:0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.398888:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596798.398909:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984781056:0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.398929:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596798.398946:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789596798.398952:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984780160:0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.398974:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596798.398988:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984780672:0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.399013:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596798.399041:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780032 00000100:00100000:0.0:1789596798.399047:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780032 00000100:00100000:0.0:1789596798.399082:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789596798.399089:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984780032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.399135:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984780032:12345-0@lo:400:kworker.0 Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596798.399141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789596798.399161:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780672 00000100:00100000:0.0:1789596798.399165:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780672 00000100:00100000:0.0:1789596798.399190:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596798.399197:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984780672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.399229:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984780672:12345-0@lo:400:kworker.0 Request processed in 32us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596798.399235:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789596798.399270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e859cd880 x1876527984780672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596798.399282:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984780672:0@lo:400:kworker.0 00000100:00100000:0.0:1789596798.399303:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984780032:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399389:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779648 00000100:00100000:1.0:1789596798.399393:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779648 00000100:00100000:1.0:1789596798.399436:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789596798.399444:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984779648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596798.399458:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596798.399494:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984779648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.399500:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789596798.399519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984779904:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399544:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.399563:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984780416:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.399603:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984780928:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399624:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.399637:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789596798.399643:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984779776:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399668:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.399726:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984780288:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399752:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.399770:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984780800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596798.399817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780544 00000100:00100000:1.0:1789596798.399821:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780544 00000100:00100000:1.0:1789596798.399844:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781056 00000100:00100000:1.0:1789596798.399847:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781056 00000100:00100000:1.0:1789596798.399871:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780160 00000100:00100000:1.0:1789596798.399874:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780160 00000100:00100000:1.0:1789596798.399884:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779904 00000100:00100000:1.0:1789596798.399886:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779904 00000100:00100000:1.0:1789596798.399895:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780416 00000100:00100000:1.0:1789596798.399897:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780416 00000100:00100000:1.0:1789596798.399908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780928 00000100:00100000:1.0:1789596798.399911:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780928 00000100:00100000:1.0:1789596798.399925:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789596798.399931:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984780544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.399963:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984780544:12345-0@lo:400:kworker.0 Request processed in 33us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.399968:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789596798.399979:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789596798.399984:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984781056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400008:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984781056:12345-0@lo:400:kworker.0 Request processed in 25us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400014:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789596798.400023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789596798.400028:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984780160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400065:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984780160:12345-0@lo:400:kworker.0 Request processed in 37us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400071:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789596798.400081:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789596798.400086:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984779904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400115:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984779904:12345-0@lo:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789596798.400130:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789596798.400135:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400157:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984780416:12345-0@lo:400:kworker.0 Request processed in 23us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789596798.400173:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789596798.400178:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984780928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400201:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984780928:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400207:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789596798.400242:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984779776 00000100:00100000:1.0:1789596798.400246:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984779776 00000100:00100000:1.0:1789596798.400270:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789596798.400275:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984779776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400302:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984779776:12345-0@lo:400:kworker.0 Request processed in 27us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400307:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789596798.400341:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780800 00000100:00100000:1.0:1789596798.400345:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780800 00000100:00100000:1.0:1789596798.400368:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789596798.400374:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984780800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400403:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984780800:12345-0@lo:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400408:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789596798.400433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984779776:0@lo:400:kworker.0 00010000:00080000:1.0:1789596798.400445:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e859cc000 x1876527984780800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596798.400454:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984780800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400463:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984779904:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400471:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984780416:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400480:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984780928:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400509:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984780288 00000100:00100000:1.0:1789596798.400512:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984780288 00000100:00100000:1.0:1789596798.400535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789596798.400541:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984780288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400572:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984780288:12345-0@lo:400:kworker.0 Request processed in 32us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596798.400577:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789596798.400596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984780288:0@lo:400:kworker.0 00000100:00100000:1.0:1789596798.400616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984780160:0@lo:400:kworker.0 00010000:00080000:1.0:1789596798.400636:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e859cea00 x1876527984780544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596798.400645:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984780544:0@lo:400:kworker.0 00010000:00080000:1.0:1789596798.400654:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e859cdc00 x1876527984781056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596798.400661:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984781056:0@lo:400:kworker.0 00010000:00080000:1.0:1789596798.400671:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd1f80 x1876527984779648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596798.400708:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984779648:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789596798.400791:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596798.400796:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596798.400798:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789596798.402391:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596798.971025:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789596799.421078:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596799.933586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596799.933611:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984781184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596799.933712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596799.933902:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781184 00000100:00100000:1.0:1789596799.933913:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781184 00000100:00100000:1.0:1789596799.933973:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789596799.933983:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984781184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596799.934020:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596799.934081:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984781184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596799.934089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789596799.934139:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984781184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596799.994249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596799.994353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596799.994399:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596799.994423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596799.994445:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596799.994500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625088 00000100:00100000:3.0:1789596799.994510:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625088 00000100:00100000:3.0:1789596799.994584:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625344 00000100:00100000:3.0:1789596799.994588:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625344 00000100:00100000:3.0:1789596799.994603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624960 00000100:00100000:3.0:1789596799.994606:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624960 00000100:00100000:3.0:1789596799.994632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625216 00000100:00100000:3.0:1789596799.994636:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625216 00000100:00100000:3.0:1789596799.994655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:3.0:1789596799.994664:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961625088:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596799.994769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:3.0:1789596799.994773:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961625088:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596799.994779:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2408:x1876527961625344:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596799.994780:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:3.0:1789596799.994798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:3.0:1789596799.994804:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961624960:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596799.994808:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2408:x1876527961625344:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596799.994814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:3.0:1789596799.994824:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961624960:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 20us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596799.994830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:2.0:1789596799.994838:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:2.0:1789596799.994854:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961625216:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596799.994878:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961625216:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00080000:0.0:1789596799.994912:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596799.994917:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596799.997423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:1.0:1789596799.998281:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961624832 00000100:00100000:1.0:1789596799.998294:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961624832 00000100:00100000:1.0:1789596799.998478:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 339 00000100:00100000:1.0:1789596799.998493:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961624832:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596799.998584:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961624832:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 94us (4347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596800.007885:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 339 00010000:00010000:0.0:1789596800.447702:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596801.470724:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596801.980964:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596801.980991:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984781312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596801.981063:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596801.981131:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781312 00000100:00100000:3.0:1789596801.981140:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781312 00000100:00100000:3.0:1789596801.981189:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789596801.981198:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984781312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596801.983661:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596801.983871:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984781312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2669us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596801.983883:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789596801.983969:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984781312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596802.493052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596803.004898:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789596803.004924:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984781568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596803.004999:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596803.005079:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984781440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596803.005129:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596803.005178:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781568 00000100:00100000:0.0:1789596803.005188:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781568 00000100:00100000:0.0:1789596803.005255:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781440 00000100:00100000:0.0:1789596803.005259:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781440 00000100:00100000:0.0:1789596803.005281:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789596803.005305:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984781568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596803.005348:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596803.005412:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984781568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.005420:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789596803.005437:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789596803.005443:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984781440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596803.005454:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789596803.005458:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596803.005483:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984781440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.005489:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1789596803.005501:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379d880 x1876527984781568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.005522:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984781568:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789596803.005533:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd1f80 x1876527984781440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.005544:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984781440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596803.517280:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596803.517312:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984781696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596803.517489:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596803.517562:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781696 00000100:00100000:1.0:1789596803.517570:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781696 00000100:00100000:1.0:1789596803.518029:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789596803.518040:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984781696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596803.518071:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596803.518115:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984781696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596803.518139:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789596803.518166:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984781824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596803.518190:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789596803.518227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379d880 x1876527984781696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.518246:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984781696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596803.518270:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781824 00000100:00100000:1.0:1789596803.518274:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781824 00000100:00100000:1.0:1789596803.518297:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789596803.518303:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984781824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789596803.518313:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596803.518355:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984781824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596803.518361:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00010000:3.0:1789596803.518650:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596803.518787:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984782080:0@lo:400:kworker.0 00000100:00080000:0.0:1789596803.519065:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596803.519452:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.519490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984782592:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.519518:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.519537:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d835e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984783104:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.519554:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596803.519733:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782080 00000100:00100000:0.0:1789596803.519739:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782080 00000100:00100000:0.0:1789596803.519774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782592 00000100:00100000:0.0:1789596803.519777:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782592 00010000:00080000:1.0:1789596803.519860:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d826c1f80 x1876527984781824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.519880:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984781824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596803.519900:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984782336:0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.519928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.519965:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789596803.519973:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984781952:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.520005:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.520026:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984782464:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.520046:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.520063:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d835eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984782976:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.520082:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.520109:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984782208:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.520129:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596803.520144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984782720:0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.525012:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984782848:0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.525083:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596803.525133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984781952 00000100:00100000:1.0:1789596803.525142:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984781952 00000100:00100000:1.0:1789596803.525191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789596803.525216:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984781952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.525276:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984781952:12345-0@lo:400:kworker.0 Request processed in 62us (5269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596803.525283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789596803.525317:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782976 00000100:00100000:1.0:1789596803.525322:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782976 00000100:00100000:1.0:1789596803.525533:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782848 00000100:00100000:1.0:1789596803.525537:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782848 00000100:00100000:1.0:1789596803.525555:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789596803.525561:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984782976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.525663:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984782976:12345-0@lo:400:kworker.0 Request processed in 101us (5579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596803.525671:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789596803.525704:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789596803.525711:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984782848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.525747:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984782848:12345-0@lo:400:kworker.0 Request processed in 36us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596803.525752:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789596803.525784:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596803.526121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783104 00000100:00100000:0.0:1789596803.526128:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783104 00000100:00100000:0.0:1789596803.526160:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782336 00000100:00100000:0.0:1789596803.526163:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782336 00000100:00100000:0.0:1789596803.526181:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789596803.526189:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526234:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984782080:12345-0@lo:400:kworker.0 Request processed in 46us (7392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.526240:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789596803.526254:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789596803.526260:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984782592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526290:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984782592:12345-0@lo:400:kworker.0 Request processed in 30us (6771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.526296:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789596803.526307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789596803.526314:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984783104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526351:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984783104:12345-0@lo:400:kworker.0 Request processed in 37us (6795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.526356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789596803.526368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789596803.526373:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984782336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526411:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984782336:12345-0@lo:400:kworker.0 Request processed in 38us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.526429:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1789596803.526451:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596803.526820:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984781952:0@lo:400:kworker.0 00010000:00080000:0.0:1789596803.526858:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d835eaa00 x1876527984782976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596803.526871:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d835eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984782976:0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526885:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984782080:0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526897:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984782592:0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.526908:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d835e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984783104:0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.527217:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d835eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984783232:0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.527259:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596803.527509:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782720 00000100:00100000:0.0:1789596803.527516:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782720 00000100:00100000:0.0:1789596803.527551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783232 00000100:00100000:0.0:1789596803.527554:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783232 00000100:00100000:0.0:1789596803.527570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789596803.527577:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984782720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.527723:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984782720:12345-0@lo:400:kworker.0 Request processed in 147us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.527731:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789596803.527746:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789596803.527752:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984783232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596803.527778:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984783232:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596803.527783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:0.0:1789596803.527828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596803.528529:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984782336:0@lo:400:kworker.0 00010000:00080000:1.0:1789596803.528549:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83695c00 x1876527984782848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.528560:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984782848:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.529190:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782464 00000100:00100000:3.0:1789596803.529200:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782464 00000100:00100000:3.0:1789596803.529234:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984782208 00000100:00100000:3.0:1789596803.529237:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984782208 00000100:00100000:3.0:1789596803.529251:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789596803.529260:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984782464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.529338:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984782464:12345-0@lo:400:kworker.0 Request processed in 79us (9289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596803.529353:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789596803.529370:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789596803.529376:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984782208:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789596803.529857:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83694380 x1876527984782720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.529872:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984782720:0@lo:400:kworker.0 00010000:00080000:1.0:1789596803.529888:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d835eb800 x1876527984783232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596803.529895:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d835eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984783232:0@lo:400:kworker.0 00000100:00100000:3.0:1789596803.530126:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984782208:12345-0@lo:400:kworker.0 Request processed in 749us (9995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596803.530143:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789596803.530187:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984782464:0@lo:400:kworker.0 00000100:00100000:1.0:1789596803.532548:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984782208:0@lo:400:kworker.0 00010000:00010000:2.0:1789596804.541133:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596805.064930:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596805.064958:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984783360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596805.065089:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596805.065162:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783360 00000100:00100000:1.0:1789596805.065171:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783360 00000100:00100000:1.0:1789596805.065224:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789596805.065235:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984783360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596805.065275:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596805.065867:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984783360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 632us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596805.065875:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789596805.065936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984783360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596805.118863:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596805.118911:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596805.118941:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596805.118941:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625472 00000100:00100000:1.0:1789596805.118955:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625472 00000100:00100000:3.0:1789596805.118962:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596805.118983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596805.119003:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625728 00000100:00100000:3.0:1789596805.119006:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625728 00000100:00100000:1.0:1789596805.119009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 341 00000100:00100000:1.0:1789596805.119019:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961625472:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596805.119046:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625984 00000100:00100000:3.0:1789596805.119049:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625984 00000100:00100000:3.0:1789596805.119060:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625600 00000100:00100000:3.0:1789596805.119062:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625600 00000100:00100000:3.0:1789596805.119074:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961625856 00000100:00100000:3.0:1789596805.119076:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961625856 00000100:00100000:3.0:1789596805.119090:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:1.0:1789596805.119093:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961625472:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596805.119096:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961625728:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596805.119111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 341 00000100:00100000:3.0:1789596805.119142:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961625728:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596805.119148:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:3.0:1789596805.119160:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 230 00000100:00100000:3.0:1789596805.119173:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961625984:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596805.119200:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961625984:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596805.119206:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 230 00000100:00100000:3.0:1789596805.119218:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:3.0:1789596805.119223:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961625600:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596805.119298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:1.0:1789596805.119306:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961625856:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596805.119310:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961625600:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596805.119316:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:1.0:1789596805.119329:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961625856:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596805.119336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00080000:1.0:1789596805.119351:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596805.119355:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789596805.564982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596805.873836:0:13538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:13:24 (1789596804) === 00000100:00100000:1.0:1789596806.097832:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596806.097940:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596806.097984:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961626240 00000100:00100000:1.0:1789596806.097997:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961626240 00000100:00100000:1.0:1789596806.098061:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789596806.098073:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:10512:x1876527961626240:12345-192.168.202.16@tcp:700:mkdir.0 00000100:00100000:1.0:1789596806.098187:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:10512:x1876527961626240:12345-192.168.202.16@tcp:700:mkdir.0 Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596806.098196:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789596806.098710:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961626112 00000100:00100000:3.0:1789596806.098716:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961626112 00000100:00100000:3.0:1789596806.098753:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789596806.098760:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961626112:12345-192.168.202.16@tcp:41:mkdir.0 00000004:00000024:3.0:1789596806.098802:0:11184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596806.098881:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961626112:12345-192.168.202.16@tcp:41:mkdir.0 Request processed in 120us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596806.098889:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789596806.100434:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.101055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961626496 00000100:00100000:0.0:1789596806.101065:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961626496 00000100:00100000:0.0:1789596806.101130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789596806.101143:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:10512:x1876527961626496:12345-192.168.202.16@tcp:36:mkdir.0 00010000:00010000:0.0:1789596806.101209:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596806.101290:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbe935 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077d9 expref: 6 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.101311:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a7fc00) 00010000:00010000:0.0:1789596806.101323:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596806.101428:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.101444:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.101455:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.101483:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.101491:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.101497:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105447:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105492:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105569:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596806.105597:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34571bd reply state 00000000edc45273 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105610:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105619:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.105622:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596806.105628:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789596806.105634:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789596806.105643:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105649:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105656:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105661:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.105666:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.105673:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.106642:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789596806.106645:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.106650:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.106657:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbea93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596806.106693:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34571bd reply state 00000000edc45273 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.106704:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.106711:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7d8259c200) 00010000:00010000:0.0:1789596806.106713:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596806.106716:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789596806.107103:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:10512:x1876527961626496:12345-192.168.202.16@tcp:36:mkdir.0 Request processed in 5957us (6669us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789596806.107113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789596806.122251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.122354:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961626624 00000100:00100000:0.0:1789596806.122365:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961626624 00000100:00100000:0.0:1789596806.122431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789596806.122444:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:10513:x1876527961626624:12345-192.168.202.16@tcp:101:chmod.0 00010000:00010000:0.0:1789596806.122472:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.122497:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeaa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0786c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.122587:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeaaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.122615:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.122630:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.122949:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789596806.122954:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596806.123000:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.123032:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeaa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0786c expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.123052:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeaaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0786c expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.123061:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789596806.123065:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596806.123069:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742e00, rc 0) 00000100:00100000:0.0:1789596806.123139:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:10513:x1876527961626624:12345-192.168.202.16@tcp:101:chmod.0 Request processed in 698us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.123148:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789596806.125916:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596806.126190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961626880 00000100:00100000:2.0:1789596806.126203:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961626880 00000100:00100000:2.0:1789596806.126269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789596806.126296:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:10513:x1876527961626880:12345-192.168.202.16@tcp:36:chmod.0 00010000:00010000:2.0:1789596806.126365:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596806.126398:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeaaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0786c expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.126419:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:2.0:1789596806.126431:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596806.126462:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.126477:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.126490:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596806.126793:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000932b9d3e reply state 00000000e52302b4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.126808:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.126814:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:2.0:1789596806.126817:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789596806.126820:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789596806.126829:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789596806.127248:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+9:10513:x1876527961626880:12345-192.168.202.16@tcp:36:chmod.0 Request processed in 952us (1341us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789596806.127257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789596806.174033:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.174157:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961627008 00000100:00100000:0.0:1789596806.174175:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961627008 00000100:00100000:0.0:1789596806.174271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1789596806.174281:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:10514:x1876527961627008:12345-192.168.202.16@tcp:101:chown.0 00010000:00010000:0.0:1789596806.174307:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.174348:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeabd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07873 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.174422:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeac4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.174437:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.174451:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.174496:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789596806.174499:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596806.174551:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.174579:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeabd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07873 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.174600:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07873 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.174609:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:0.0:1789596806.174612:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596806.174617:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742e00, rc 0) 00000100:00100000:0.0:1789596806.174743:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+10:10514:x1876527961627008:12345-192.168.202.16@tcp:101:chown.0 Request processed in 462us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.174753:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789596806.178100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.178228:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961627136 00000100:00100000:0.0:1789596806.178258:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961627136 00000100:00100000:0.0:1789596806.178378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:0.0:1789596806.178392:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+10:10514:x1876527961627136:12345-192.168.202.16@tcp:101:chown.0 00010000:00010000:0.0:1789596806.178416:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.178439:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeacb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0787a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178528:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178549:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178564:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178575:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178582:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178588:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178672:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbeae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178700:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbeae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.178708:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbeae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.178759:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789596806.178763:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596806.182373:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbeae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182410:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182419:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182429:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182436:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.182442:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182452:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:0.0:1789596806.182481:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.182487:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182493:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbead2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182513:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182547:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182553:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182558:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.182561:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182568:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182576:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7d8259c200) 00010000:00010000:0.0:1789596806.182578:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.182581:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182587:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbead9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182651:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeacb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0787a expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182667:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbeae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0787a expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.182676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.182697:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596806.182705:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789596806.182827:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+11:10514:x1876527961627136:12345-192.168.202.16@tcp:101:chown.0 Request processed in 4436us (4739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.182837:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789596806.195861:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596806.195902:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961627264 00000100:00100000:3.0:1789596806.195912:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961627264 00000100:00100000:3.0:1789596806.195961:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789596806.195970:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2396ff16-3863-41e8-8748-2ac67b0298b6+11:10514:x1876527961627264:12345-192.168.202.16@tcp:900:chown.0 00000100:00100000:3.0:1789596806.196066:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2396ff16-3863-41e8-8748-2ac67b0298b6+11:10514:x1876527961627264:12345-192.168.202.16@tcp:900:chown.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596806.196074:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789596806.201305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596806.201376:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961627520 00000100:00100000:3.0:1789596806.201388:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961627520 00000100:00100000:3.0:1789596806.201473:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:3.0:1789596806.201487:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+11:10514:x1876527961627520:12345-192.168.202.16@tcp:36:chown.0 00010000:00010000:3.0:1789596806.201569:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596806.201606:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbeae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0787a expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.201638:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:3.0:1789596806.201644:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596806.201721:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.201741:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.201755:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596806.211969:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789596806.212064:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212080:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212110:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212116:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596806.212121:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212130:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212147:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7d8259c200) 00010000:00010000:3.0:1789596806.212149:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596806.212154:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212160:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbea9a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212184:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212191:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212196:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212201:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596806.212203:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212219:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212228:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:3.0:1789596806.212230:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596806.212232:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212237:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeaa1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212248:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212253:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212258:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212262:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596806.212265:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212270:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212277:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:3.0:1789596806.212279:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789596806.212282:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212297:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbeab6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596806.212362:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f687cd5d reply state 00000000d4ea567b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212379:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.212388:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:3.0:1789596806.212391:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789596806.212394:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789596806.212409:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1789596806.212531:0:8967:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789596806.212555:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:10514:x1876527961627520:12345-192.168.202.16@tcp:36:chown.0 Request processed in 11066us (11262us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789596806.212566:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00010000:00010000:2.0:1789596806.214175:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.214206:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.214215:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.214222:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596806.214226:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.214235:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.214252:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:2.0:1789596806.214256:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596806.214260:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.214268:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbeae7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596806.233255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596806.233608:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961627648 00000100:00100000:1.0:1789596806.233620:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961627648 00000100:00100000:1.0:1789596806.233719:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789596806.233732:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:10515:x1876527961627648:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:1.0:1789596806.233761:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596806.233813:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c7200/0x7b5398e289bbeaee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07881 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596806.237191:0:11184:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3326us 00010000:00010000:0.0:1789596806.248601:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248627:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248642:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248661:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248669:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248702:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248861:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbeb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248870:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248877:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.248920:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789596806.248924:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596806.248967:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248981:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248988:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.248996:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249001:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.249005:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249013:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249026:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:0.0:1789596806.249029:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.249033:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249039:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeaf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249049:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249064:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249071:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249076:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.249079:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249086:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249094:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7d8259c200) 00010000:00010000:0.0:1789596806.249097:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.249100:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249106:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeafc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249150:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c7200/0x7b5398e289bbeaee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07881 expref: 8 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249166:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbeb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07881 expref: 7 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.249173:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.249176:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789596806.249184:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743200, rc 0) 00000100:00100000:0.0:1789596806.249263:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+7:10515:x1876527961627648:12345-192.168.202.16@tcp:101:touch.500 Request processed in 15534us (16019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.249273:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789596806.258174:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.258249:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961627904 00000100:00100000:0.0:1789596806.258260:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961627904 00000100:00100000:0.0:1789596806.258321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789596806.258341:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:10515:x1876527961627904:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:0.0:1789596806.258364:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.258384:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeb0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07888 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.258496:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.258511:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.258523:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.258603:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.258613:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.258620:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596806.259296:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789596806.259452:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259462:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259469:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259499:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259507:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259514:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259520:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.259525:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259532:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.259543:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.259545:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.259549:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.260210:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596806.260235:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000023694a1 reply state 00000000e019c2c1 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.260248:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.260256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789596806.260258:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596806.260261:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789596806.260300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeb0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07888 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.260314:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07888 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.260321:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7d8259c200) 00010000:00010000:0.0:1789596806.260324:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596806.260326:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742000, rc 0) 00000100:00100000:0.0:1789596806.260408:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+10:10515:x1876527961627904:12345-192.168.202.16@tcp:101:touch.500 Request processed in 2079us (2243us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789596806.260417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789596806.271075:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596806.271864:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961628160 00000100:00100000:2.0:1789596806.271875:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961628160 00000100:00100000:2.0:1789596806.271930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789596806.271939:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+10:10515:x1876527961628160:12345-192.168.202.16@tcp:36:touch.500 00010000:00010000:2.0:1789596806.271991:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596806.272015:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07888 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.272046:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7d8259c200) 00010000:00010000:2.0:1789596806.272054:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596806.272103:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.272115:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.272125:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596806.272228:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084d10bee reply state 000000004db3bfc9 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.272237:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.272241:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:2.0:1789596806.272243:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596806.272245:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596806.272342:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+11:10515:x1876527961628160:12345-192.168.202.16@tcp:36:touch.500 Request processed in 404us (1278us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789596806.272347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1789596806.278027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.278151:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961628288 00000100:00100000:0.0:1789596806.278162:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961628288 00000100:00100000:0.0:1789596806.278229:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789596806.278240:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+11:10515:x1876527961628288:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:0.0:1789596806.278267:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.278289:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeb34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0788f expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.278481:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeb34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0788f expref: 12 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.278497:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeb34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0788f expref: 12 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.278517:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:0.0:1789596806.278520:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596806.278524:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742800, rc 0) 00000100:00100000:0.0:1789596806.278875:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+12:10515:x1876527961628288:12345-192.168.202.16@tcp:101:touch.500 Request processed in 636us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.278884:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:3.0:1789596806.283047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596806.283192:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961628416 00000100:00100000:1.0:1789596806.283201:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961628416 00000100:00100000:1.0:1789596806.283246:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789596806.283253:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1876527961628416:12345-192.168.202.16@tcp:8:touch.500 00010000:00080000:1.0:1789596806.283286:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:1.0:1789596806.283317:0:8435:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbeb3b 00002000:00100000:1.0:1789596806.283329:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2396ff16-3863-41e8-8748-2ac67b0298b6/ffff9c7d83c2f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789596806.283344:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789596806.283408:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789596806.283436:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c2f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596806.283866:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961628416:12345-192.168.202.16@tcp:8:touch.500 Request processed in 609us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596806.283875:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789596806.293807:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596806.293988:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961628544 00000100:00100000:2.0:1789596806.293999:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961628544 00000100:00100000:2.0:1789596806.294116:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789596806.294127:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961628544:12345-192.168.202.16@tcp:2:touch.500 00000100:00080000:1.0:1789596806.295413:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789596806.295980:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789596806.295991:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000100:00100000:2.0:1789596806.296219:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:0:x1876527961628544:12345-192.168.202.16@tcp:2:touch.500 Request processed in 2091us (2431us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789596806.296233:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789596806.303257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.303414:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961628800 00000100:00100000:0.0:1789596806.303425:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961628800 00000100:00100000:0.0:1789596806.303528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1789596806.303540:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+12:10515:x1876527961628800:12345-192.168.202.16@tcp:35:touch.500 00000100:00100000:0.0:1789596806.303887:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+13:10515:x1876527961628800:12345-192.168.202.16@tcp:35:touch.500 Request processed in 349us (642us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789596806.303895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789596806.337670:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.337934:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961628928 00000100:00100000:0.0:1789596806.337946:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961628928 00000100:00100000:0.0:1789596806.338008:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789596806.338021:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+13:10516:x1876527961628928:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:0.0:1789596806.338062:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.338085:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07896 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.338166:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeb49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.338182:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.338193:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.338242:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789596806.338247:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596806.338289:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.338319:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07896 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.338340:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07896 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.338349:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.338352:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596806.338357:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743000, rc 0) 00000100:00100000:0.0:1789596806.338456:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+14:10516:x1876527961628928:12345-192.168.202.16@tcp:101:rm.0 Request processed in 437us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.338464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1789596806.344091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596806.344194:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961629184 00000100:00100000:2.0:1789596806.344205:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961629184 00000100:00100000:2.0:1789596806.344269:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789596806.344281:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+14:10516:x1876527961629184:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1789596806.344303:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596806.344324:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeb50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0789d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596806.344445:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789596806.344613:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeb50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0789d expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.344629:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:2.0:1789596806.344632:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596806.344639:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeb50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0789d expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.344652:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dda00, rc 0) 00000100:00100000:2.0:1789596806.345743:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+15:10516:x1876527961629184:12345-192.168.202.16@tcp:101:rm.0 Request processed in 1455us (1652us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789596806.345754:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789596806.363204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596806.364100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961629312 00000100:00100000:3.0:1789596806.364116:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961629312 00000100:00100000:3.0:1789596806.364184:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789596806.364196:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+15:10516:x1876527961629312:12345-192.168.202.16@tcp:37:rm.0 00000100:00100000:0.0:1789596806.371568:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+15:10516:x1876527961629312:12345-192.168.202.16@tcp:37:rm.0 Request processed in 7363us (8364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.371582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789596806.383576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.383856:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961629568 00000100:00100000:0.0:1789596806.383868:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961629568 00000100:00100000:0.0:1789596806.383991:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789596806.384003:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87fb0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+15:10516:x1876527961629568:12345-192.168.202.16@tcp:35:rm.0 00000100:00100000:0.0:1789596806.384248:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87fb0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:10516:x1876527961629568:12345-192.168.202.16@tcp:35:rm.0 Request processed in 246us (698us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789596806.384257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1789596806.388336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.388484:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961629824 00000100:00100000:0.0:1789596806.388494:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961629824 00000100:00100000:0.0:1789596806.388571:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789596806.388582:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+16:10516:x1876527961629824:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:0.0:1789596806.388608:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.388639:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078a4 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.389071:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbeb65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.389087:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbeb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.389099:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbeb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.389110:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789596806.389241:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078a4 expref: 19 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.389260:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbeb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078a4 expref: 18 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.389268:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.389271:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596806.389275:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742600, rc 0) 00000100:00100000:0.0:1789596806.389520:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961629824:12345-192.168.202.16@tcp:101:rm.0 Request processed in 940us (1193us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789596806.389530:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789596806.397866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596806.398074:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961629952 00000100:00100000:2.0:1789596806.398098:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961629952 00000100:00100000:2.0:1789596806.398159:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789596806.398168:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961629952:12345-192.168.202.16@tcp:41:rm.0 00000004:00000024:2.0:1789596806.398224:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789596806.398296:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961629952:12345-192.168.202.16@tcp:41:rm.0 Request processed in 128us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596806.398303:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1789596806.401764:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.401921:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961630080 00000100:00100000:0.0:1789596806.401934:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961630080 00000100:00100000:0.0:1789596806.402005:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789596806.402015:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961630080:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:0.0:1789596806.402038:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596806.402062:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078ab expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402170:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402186:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402199:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402226:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402234:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402242:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402380:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402391:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402398:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.402432:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789596806.402437:0:8967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596806.402455:0:8967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402468:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402477:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402483:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402500:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402506:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.402509:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402517:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402530:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.402534:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.402539:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402545:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402573:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402580:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402586:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402591:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.402594:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402611:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402620:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789596806.402622:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.402626:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402632:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402660:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ab expref: 20 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402674:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ab expref: 19 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.402734:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:0.0:1789596806.402736:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596806.402738:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742c00, rc 0) 00000100:00100000:0.0:1789596806.402814:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+19:10516:x1876527961630080:12345-192.168.202.16@tcp:101:rm.0 Request processed in 799us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596806.402823:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1789596806.410948:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.411031:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961630336 00000100:00100000:0.0:1789596806.411042:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961630336 00000100:00100000:0.0:1789596806.411112:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:0.0:1789596806.411125:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+19:10516:x1876527961630336:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:0.0:1789596806.411187:0:11184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789596806.411232:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbeb88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ab expref: 19 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411257:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbeb34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0788f expref: 18 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411268:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:0.0:1789596806.411280:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbeb49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07896 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411289:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.411293:0:11184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596806.411329:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411343:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411353:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411363:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411371:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411378:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411474:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411489:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411496:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596806.411806:0:11184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789596806.411818:0:11184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381230139095ns, next at 382230136343ns, rc = 0 00010000:00010000:0.0:1789596806.411870:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411905:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411920:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411928:0:11184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411935:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411941:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411959:0:11184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596806.411978:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411984:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.411999:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412006:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.412011:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412019:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412028:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:0.0:1789596806.412031:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789596806.412035:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412041:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbeb9d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412058:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412065:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412071:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412076:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.412079:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412096:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412104:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.412106:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.412110:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412116:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbeb8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596806.412126:0:11184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000339cc35c reply state 000000001d2ef020 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412137:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.412142:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789596806.412144:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596806.412147:0:11184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596806.412222:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961630336:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1098us (1286us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789596806.412232:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00010000:00010000:3.0:1789596806.413324:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596806.413349:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.413358:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596806.413362:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.413370:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.413386:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:3.0:1789596806.413388:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789596806.413392:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.413397:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbeba4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.413411:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596806.413413:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596806.413415:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596806.420556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596806.420659:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961630592 00000100:00100000:1.0:1789596806.420671:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961630592 00000100:00100000:1.0:1789596806.420769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789596806.420789:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961630592:12345-192.168.202.16@tcp:35:rm.0 00000100:00100000:1.0:1789596806.421052:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:10516:x1876527961630592:12345-192.168.202.16@tcp:35:rm.0 Request processed in 271us (505us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789596806.421060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789596806.424177:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596806.424261:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961630848 00000100:00100000:0.0:1789596806.424272:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961630848 00000100:00100000:0.0:1789596806.424343:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789596806.424353:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:10516:x1876527961630848:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:0.0:1789596806.424409:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789596806.424436:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbeb65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078a4 expref: 19 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424475:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbeb03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07881 expref: 18 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424487:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c900) 00010000:00010000:0.0:1789596806.424504:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbeac4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07873 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424513:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8300) 00010000:00010000:0.0:1789596806.424519:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596806.424541:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424554:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424578:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424592:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424600:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424607:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424731:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424751:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.424758:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596806.425012:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789596806.425026:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425034:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425041:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425048:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.425052:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425060:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425068:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:0.0:1789596806.425071:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789596806.425074:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425080:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743000/0x7b5398e289bbebb9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425097:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425110:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425116:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425122:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596806.425125:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425131:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425139:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cf00) 00010000:00010000:0.0:1789596806.425141:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596806.425144:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425149:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bbebab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596806.425161:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dad93ae reply state 000000001cde7682 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425174:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596806.425180:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7d8259cd00) 00010000:00010000:0.0:1789596806.425183:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596806.425186:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596806.425619:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+18:10516:x1876527961630848:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1264us (1448us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789596806.425635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00010000:00010000:2.0:1789596806.590344:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596807.101345:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596807.101396:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d826c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984783488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596807.101526:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596807.101709:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783488 00000100:00100000:0.0:1789596807.101717:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783488 00000100:00100000:0.0:1789596807.101781:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789596807.101792:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984783488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789596807.101829:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789596807.101901:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984783488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596807.101908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789596807.102616:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d826c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984783488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596807.617183:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596808.125303:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984783616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596808.125382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596808.125472:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783616 00000100:00100000:1.0:1789596808.125480:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783616 00000100:00100000:1.0:1789596808.125538:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789596808.125549:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984783616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596808.125573:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596808.125621:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984783616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596808.125628:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789596808.125650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596808.125713:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67c5f80 x1876527984783616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.125731:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984783616:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789596808.126011:0:8520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382944331347ns, next at 383944327617ns, rc = 0 00000100:00100000:3.0:1789596808.126123:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596808.126136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984783744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596808.126172:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.126243:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783744 00000100:00100000:2.0:1789596808.126248:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783744 00000100:00100000:2.0:1789596808.126300:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789596808.126308:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984783744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596808.126321:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596808.126361:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984783744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.126368:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1789596808.126395:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd2d80 x1876527984783744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596808.126407:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984783744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596808.126497:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789596808.636976:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596808.637220:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984784000:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637300:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.637356:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984784512:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.637434:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984785024:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637469:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.637498:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789596808.637503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984784128:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.637561:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984784640:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637581:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.637611:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984785152:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637632:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.637663:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784000 00000100:00100000:2.0:1789596808.637671:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784000 00000100:00100000:2.0:1789596808.637754:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784512 00000100:00100000:2.0:1789596808.637758:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784512 00000100:00100000:2.0:1789596808.637795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785024 00000100:00100000:2.0:1789596808.637798:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785024 00000100:00100000:2.0:1789596808.637810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784640 00000100:00100000:2.0:1789596808.637813:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784640 00000100:00100000:2.0:1789596808.637825:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785152 00000100:00100000:2.0:1789596808.637827:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785152 00000100:00100000:2.0:1789596808.637845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789596808.637855:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984784000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637913:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984784000:12345-0@lo:400:kworker.0 Request processed in 59us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.637920:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789596808.637938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789596808.637944:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984784512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.637984:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984784512:12345-0@lo:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.637990:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789596808.638003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789596808.638009:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984785024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.638034:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984785024:12345-0@lo:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.638039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789596808.638049:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789596808.638053:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984784640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.638077:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984784640:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.638082:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789596808.638091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789596808.638096:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984785152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.638123:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984785152:12345-0@lo:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.638128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1789596808.638151:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596808.638156:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789596808.638181:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb210000 x1876527984784640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596808.638196:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984784640:0@lo:400:kworker.0 00010000:00080000:2.0:1789596808.638207:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5500 x1876527984785152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596808.638227:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984785152:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.638238:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984784000:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.638247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984784512:0@lo:400:kworker.0 00000100:00100000:2.0:1789596808.638256:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984785024:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638544:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984784256:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638582:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984784768:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638628:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638649:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984785280:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638709:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789596808.638716:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984783872:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638744:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638776:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984784384:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638801:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638821:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984784896:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638841:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638859:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984785408:0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638880:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.638917:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784256 00000100:00100000:0.0:1789596808.638922:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784256 00000100:00100000:0.0:1789596808.638952:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789596808.638959:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984784256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.638998:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984784256:12345-0@lo:400:kworker.0 Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.639004:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789596808.639023:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784128 00000100:00100000:0.0:1789596808.639026:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784128 00000100:00100000:0.0:1789596808.639042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784384 00000100:00100000:0.0:1789596808.639045:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784384 00000100:00100000:0.0:1789596808.639058:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789596808.639064:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984784128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.639101:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984784128:12345-0@lo:400:kworker.0 Request processed in 37us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.639107:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789596808.639119:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789596808.639124:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984784384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.639151:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984784384:12345-0@lo:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.639157:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789596808.639180:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784768 00000100:00100000:0.0:1789596808.639183:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784768 00000100:00100000:0.0:1789596808.639201:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785280 00000100:00100000:0.0:1789596808.639203:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785280 00000100:00100000:0.0:1789596808.639224:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984784896 00000100:00100000:0.0:1789596808.639227:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984784896 00000100:00100000:0.0:1789596808.639238:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785408 00000100:00100000:0.0:1789596808.639240:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785408 00000100:00100000:0.0:1789596808.639269:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789596808.639275:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984784768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.641898:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984784768:12345-0@lo:400:kworker.0 Request processed in 2613us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.641912:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789596808.641950:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789596808.641963:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984785280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.642002:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984785280:12345-0@lo:400:kworker.0 Request processed in 45us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.642008:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789596808.642019:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789596808.642025:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984784896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.642054:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984784896:12345-0@lo:400:kworker.0 Request processed in 30us (3212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.642059:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789596808.642070:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789596808.642076:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984785408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.642129:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984785408:12345-0@lo:400:kworker.0 Request processed in 53us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.642135:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789596808.642169:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984783872 00000100:00100000:0.0:1789596808.642177:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984783872 00000100:00100000:0.0:1789596808.644291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789596808.644321:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596808.644769:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984783872:12345-0@lo:400:kworker.0 Request processed in 453us (6013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.644796:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789596808.645057:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596808.645075:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596808.645167:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596808.645208:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785536 00000100:00100000:1.0:1789596808.645215:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785536 00000100:00100000:1.0:1789596808.645254:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596808.645260:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984785536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596808.645300:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596808.645338:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984785536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596808.645345:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1789596808.645397:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67c5f80 x1876527984785536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.645415:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596808.647867:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984785664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596808.647948:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596808.648114:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785664 00000100:00100000:2.0:1789596808.648124:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785664 00000100:00100000:2.0:1789596808.648178:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596808.648188:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984785664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789596808.648215:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596808.648262:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984785664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596808.648269:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1789596808.648557:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83d6e680 x1876527984785664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.648579:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984785664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596808.650017:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984783872:0@lo:400:kworker.0 00000100:00100000:1.0:1789596808.650038:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984784384:0@lo:400:kworker.0 00010000:00080000:1.0:1789596808.650054:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212a00 x1876527984784896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.650065:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984784896:0@lo:400:kworker.0 00010000:00080000:1.0:1789596808.650078:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b7800 x1876527984785408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.650086:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984785408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596808.650098:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984784256:0@lo:400:kworker.0 00010000:00080000:1.0:1789596808.650129:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212300 x1876527984784768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.650137:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984784768:0@lo:400:kworker.0 00010000:00080000:1.0:1789596808.650148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836b5880 x1876527984785280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596808.650154:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984785280:0@lo:400:kworker.0 00000100:00100000:1.0:1789596808.650195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984784128:0@lo:400:kworker.0 00000100:00080000:0.0:1789596808.651646:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596809.661033:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596810.173831:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984785792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596810.173913:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596810.173990:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785792 00000100:00100000:2.0:1789596810.173999:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785792 00000100:00100000:2.0:1789596810.174090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789596810.174100:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984785792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596810.174133:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596810.175630:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984785792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1524us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596810.175643:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789596810.179189:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984785792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596810.232244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596810.232285:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596810.232316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596810.232378:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596810.232405:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631104 00000100:00100000:2.0:1789596810.232406:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596810.232420:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631104 00000100:00100000:2.0:1789596810.232454:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596810.232482:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631616 00000100:00100000:2.0:1789596810.232487:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631616 00000100:00100000:3.0:1789596810.232496:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631232 00000100:00100000:3.0:1789596810.232501:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631232 00000100:00100000:2.0:1789596810.232515:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631488 00000100:00100000:2.0:1789596810.232520:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631488 00000100:00100000:3.0:1789596810.232527:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:3.0:1789596810.232540:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+18:2409:x1876527961631104:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596810.232547:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:2.0:1789596810.232569:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961631616:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596810.232879:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961631616:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 311us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596810.232887:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:2.0:1789596810.232908:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:2.0:1789596810.232915:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961631232:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596810.233201:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631360 00000100:00100000:1.0:1789596810.233206:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631360 00000100:00100000:1.0:1789596810.233244:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789596810.233251:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961631360:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596810.234718:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+18:2409:x1876527961631104:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 2171us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596810.234731:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:3.0:1789596810.234780:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:0.0:1789596810.234782:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961630976 00000100:00100000:0.0:1789596810.234791:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961630976 00000100:00100000:3.0:1789596810.234793:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961631488:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596810.234833:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 343 00000100:00100000:3.0:1789596810.234844:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961631488:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 54us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596810.234846:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961630976:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596810.234859:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00080000:3.0:1789596810.234881:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596810.234886:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961630976:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (2507us total) trans 0 rc 0/0 00000100:00080000:3.0:1789596810.234887:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596810.234891:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596810.234898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 343 00000100:00100000:2.0:1789596810.236831:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961631232:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 3904us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596810.236846:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:1.0:1789596810.237204:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961631360:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 3951us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596810.237216:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00010000:00010000:2.0:1789596810.685003:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596811.712241:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596811.834921:0:13686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789596812.224900:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984785920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596812.224999:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596812.225106:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984785920 00000100:00100000:1.0:1789596812.225117:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984785920 00000100:00100000:1.0:1789596812.225181:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789596812.225191:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984785920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596812.225251:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596812.225309:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984785920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596812.225317:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789596812.225375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984785920:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1789596812.233355:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789596812.233850:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:1.0:1789596812.233859:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984786048:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789596812.233868:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789596812.233971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596812.234019:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.234033:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.234041:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.234048:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596812.234053:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.234630:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984786048 00000100:00100000:0.0:1789596812.234643:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984786048 00000100:00100000:0.0:1789596812.234770:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596812.234782:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984786048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789596812.234824:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1789596812.234873:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aab1486, atime: 0x6aab1486, ctime: 0x6aab1486, blocks: 0x0 00010000:00010000:0.0:1789596812.234883:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.234903:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1789596812.234908:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596812.234916:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.234951:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.234963:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.234971:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.234991:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1789596812.235878:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789596812.239185:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789596812.239205:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984786048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4416us (5226us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1789596812.239208:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.239221:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789596812.239223:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789596812.239229:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.239243:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.239314:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.239323:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bbebc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.239350:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596812.239352:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596812.239353:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596812.239908:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.239932:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff9c7d8259cb00) 00010000:00010000:3.0:1789596812.239936:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596812.239943:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.239951:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbeb18 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.239979:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.239987:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.239994:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.239999:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596812.240004:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240021:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240030:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c7e993a8100) 00010000:00010000:3.0:1789596812.240032:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596812.240036:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596812.240119:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7eb674fb80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789596812.240131:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984786048:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789596812.240163:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeb2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240192:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240199:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240205:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240210:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596812.240213:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240219:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240227:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff9c7d8259cb00) 00010000:00010000:3.0:1789596812.240230:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596812.240233:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240238:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbeb96 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240305:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240311:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240323:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240328:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596812.240331:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240337:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240345:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7d8259cd00) 00010000:00010000:3.0:1789596812.240348:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596812.240351:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.240357:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbebb2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.734924:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789596812.883351:0:13734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7c03e2c0 20000000:00000080:1.0:1789596812.883378:0:13734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7d820b3400 uarg=0000000000000000 20000000:01000000:1.0:1789596812.883440:0:13734:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789596812.883449:0:13734:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789596812.883585:0:13734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789596812.885800:0:13735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789596812.886226:0:13734:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789596812.894187:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789596812.894233:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789596812.894319:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789596812.894337:0:13734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789596812.894356:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894377:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894386:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894396:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894414:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894422:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894428:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894435:0:13734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894474:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894487:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 23 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.894502:0:13734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786176:0@lo:104: 00000100:00100000:0.0:1789596812.894835:0:13734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596812.894950:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.894961:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 23 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.894970:0:13734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786304:0@lo:104: 00000100:00100000:2.0:1789596812.894979:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789596812.895026:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596812.895065:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984786176 00000100:00100000:2.0:1789596812.895077:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984786176 00000100:00100000:1.0:1789596812.895080:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984786304 00000100:00100000:1.0:1789596812.895091:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984786304 00000100:00100000:2.0:1789596812.895144:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789596812.895157:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596812.895158:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:13734:x1876527984786176:12345-0@lo:104: 00010000:00010000:2.0:1789596812.895185:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.895195:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 23 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.895209:0:13734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786432:0@lo:104: 00000100:00100000:0.0:1789596812.895448:0:13734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596812.895473:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789596812.895516:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.895518:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596812.895531:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.895534:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 23 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.895546:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596812.895555:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.895582:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.895590:0:13734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83697b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786560:0@lo:104: 10000000:00010000:3.0:1789596812.895614:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.895625:0:13734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789596812.895637:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789596812.895658:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:13734:x1876527984786176:12345-0@lo:104: Request processed in 327us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596812.895668:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789596812.895911:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.895925:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 12 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.895935:0:13734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786688:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596812.895987:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596812.895996:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 12 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596812.896014:0:13734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786816:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596812.896039:0:13734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83764c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596812.896068:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984786432 00000100:00100000:0.0:1789596812.896075:0:13734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786176:0@lo:104: 00000100:00100000:2.0:1789596812.896077:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984786432 00000100:00100000:2.0:1789596812.896110:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984786560 00000100:00100000:2.0:1789596812.896114:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984786560 00000100:00100000:2.0:1789596812.896142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596812.896148:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+5:13734:x1876527984786304:12345-0@lo:104: 00010000:00010000:2.0:1789596812.896158:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.896353:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.896361:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596812.896389:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.896397:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81670e00/0x7b5398e289bbea85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.896415:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596812.896417:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596812.896419:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596812.896473:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596812.896479:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+5:13734:x1876527984786304:12345-0@lo:104: Request processed in 331us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596812.896486:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596812.896508:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596812.896514:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:13734:x1876527984786432:12345-0@lo:104: 00010000:00010000:2.0:1789596812.896523:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.896557:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596812.896562:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+4:13734:x1876527984786432:12345-0@lo:104: Request processed in 49us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596812.896568:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596812.896579:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789596812.896584:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:13734:x1876527984786560:12345-0@lo:104: 00010000:00010000:2.0:1789596812.896591:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.896622:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596812.896626:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d576172c-8178-43f9-add9-c496dd76058d+3:13734:x1876527984786560:12345-0@lo:104: Request processed in 43us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596812.896632:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789596812.896654:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596812.896659:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.896667:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596812.896670:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.896703:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596812.896714:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596812.896730:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596812.896755:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.896761:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596812.896935:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596812.896941:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.896948:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596812.896956:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.896973:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596812.896980:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596812.896993:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596812.897007:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.897014:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789596812.900487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984786944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596812.900829:0:13734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786304:0@lo:104: 00000100:00100000:0.0:1789596812.900858:0:13734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786432:0@lo:104: 00000100:00100000:0.0:1789596812.900868:0:13734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83697b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786560:0@lo:104: 00000100:00100000:0.0:1789596812.901217:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984787072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596812.901403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596812.901464:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596812.901472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984787200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596812.901495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596812.901770:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.901787:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81671a00/0x7b5398e289bbea69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.901811:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596812.901817:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596812.901833:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596812.901837:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596812.901850:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.901863:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596812.901872:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596812.901879:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596812.901935:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.901997:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596812.902037:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902045:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da800/0x7b5398e289bbea5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902056:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596812.902058:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596812.902060:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596812.902087:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787072 00000100:00100000:3.0:1789596812.902095:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787072 00010000:00010000:3.0:1789596812.902131:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 24 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.902161:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787200 00000100:00100000:3.0:1789596812.902164:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787200 00010000:00010000:3.0:1789596812.902175:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 25 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.902185:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984786944 00000100:00100000:3.0:1789596812.902188:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984786944 00010000:00010000:3.0:1789596812.902197:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 26 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.902210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596812.902219:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+26:3646:x1876527984787072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.902234:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596812.902240:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 26 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902252:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 26 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902274:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671000/0x7b5398e289bbea7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbea77 expref: 26 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902287:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596812.902344:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+25:3646:x1876527984787072:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596812.902351:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596812.902370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789596812.902375:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984787200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.902382:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596812.902386:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 24 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902393:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 24 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902403:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbea70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbea69 expref: 24 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902411:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596812.902432:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+23:3646:x1876527984787200:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596812.902437:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789596812.902448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596812.902453:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+22:3645:x1876527984786944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.902460:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596812.902464:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 22 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902480:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 22 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902490:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bbea8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbea85 expref: 22 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902499:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596812.902523:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+21:3645:x1876527984786944:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596812.902529:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596812.902708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984787328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596812.902767:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596812.902821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984787200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596812.902831:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984787072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.902856:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596812.902866:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787328 00000100:00100000:3.0:1789596812.902870:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787328 00010000:00010000:3.0:1789596812.902885:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 21 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.902903:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789596812.902909:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+21:3644:x1876527984787328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.902917:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596812.902920:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 21 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902940:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 21 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902951:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671400/0x7b5398e289bbea62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbea5b expref: 21 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.902960:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596812.902987:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+20:3644:x1876527984787328:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596812.902993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789596812.903015:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984787328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596812.904913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984786944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596812.907055:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596812.907163:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596812.907233:0:13734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83694700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786688:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596812.907261:0:13734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1876527984786816:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596812.907322:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631872 00010000:00010000:1.0:1789596812.907326:0:13734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.907335:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631872 00010000:00010000:3.0:1789596812.907391:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 13 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.907430:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961631744 00000100:00100000:3.0:1789596812.907434:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961631744 00010000:00010000:3.0:1789596812.907446:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 14 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596812.907470:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:3.0:1789596812.907482:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+14:2409:x1876527961631872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.907501:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596812.907508:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 14 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907595:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 14 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907631:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbea4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0785e expref: 14 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907650:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596812.907876:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961631872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 396us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596812.907885:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:3.0:1789596812.907906:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1789596812.907913:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+12:2408:x1876527961631744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596812.907920:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596812.907924:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 12 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907935:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 12 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907946:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbea54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07865 expref: 12 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907958:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907968:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.907988:0:7927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908007:0:7927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908015:0:7927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908023:0:7927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908030:0:7927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596812.908035:0:7927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908045:0:7927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908058:0:7927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596812.908069:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596812.908090:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+11:2408:x1876527961631744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 177us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596812.908097:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00010000:00010000:1.0:1789596812.908178:0:13734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596812.908192:0:13734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596812.908201:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743200/0x7b5398e289bbebc7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.908395:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.908406:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db800/0x7b5398e289bbea77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbea7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596812.908429:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596812.908431:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596812.908436:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596813.247002:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984787456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596813.247108:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.247210:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787456 00000100:00100000:3.0:1789596813.247221:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787456 00000100:00100000:3.0:1789596813.247281:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596813.247291:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984787456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596813.247343:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596813.247401:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984787456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.247409:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596813.247473:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984787456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596813.250367:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984787584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596813.250465:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.250580:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787584 00000100:00100000:0.0:1789596813.250592:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787584 00000100:00100000:0.0:1789596813.250705:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789596813.250716:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984787584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596813.250757:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596813.250818:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984787584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.250826:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789596813.250959:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596813.251013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984787584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596813.764250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984787840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596813.764354:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.764460:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787840 00000100:00100000:0.0:1789596813.764470:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787840 00000100:00100000:0.0:1789596813.764545:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789596813.764557:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984787840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596813.764597:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596813.764662:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984787840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.764670:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789596813.764726:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596813.764766:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e859cea00 x1876527984787840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596813.764788:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e859cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984787840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596813.765243:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596813.765309:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.765338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984788224:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.765368:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.765391:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984788736:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.765417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.765441:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789596813.765449:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984788096:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.765474:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.765490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984788608:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.765509:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.765527:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984789120:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.765550:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596813.765741:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787712 00000100:00100000:3.0:1789596813.765750:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787712 00000100:00100000:3.0:1789596813.765810:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596813.765819:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984787712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596813.765840:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596813.765885:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984787712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.765893:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596813.765919:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788224 00000100:00100000:3.0:1789596813.765923:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788224 00000100:00100000:3.0:1789596813.765954:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789596813.765961:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984788224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.765996:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984788224:12345-0@lo:400:kworker.0 Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.766002:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789596813.766021:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788736 00000100:00100000:3.0:1789596813.766024:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788736 00000100:00100000:3.0:1789596813.766062:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788096 00000100:00100000:3.0:1789596813.766065:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788096 00000100:00100000:3.0:1789596813.766085:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788608 00000100:00100000:3.0:1789596813.766088:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788608 00000100:00100000:3.0:1789596813.766103:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789596813.766109:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984788736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.766140:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984788736:12345-0@lo:400:kworker.0 Request processed in 31us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.766146:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789596813.766159:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789596813.766166:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984788096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.766195:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984788096:12345-0@lo:400:kworker.0 Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.766208:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789596813.766222:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789596813.766229:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984788608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.766259:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984788608:12345-0@lo:400:kworker.0 Request processed in 31us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.766264:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00010000:3.0:1789596813.766293:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596813.766332:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984788096:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.766342:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984788608:0@lo:400:kworker.0 00010000:00080000:3.0:1789596813.766353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67c6d80 x1876527984787712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596813.766368:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596813.766377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984788224:0@lo:400:kworker.0 00010000:00080000:3.0:1789596813.766386:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb674dc00 x1876527984788736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596813.766394:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984788736:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.766884:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984787968:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.766944:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.766998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984788480:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767024:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.767045:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984788992:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767068:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.767089:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789596813.767096:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984788352:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767116:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.767147:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984788864:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.767205:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789120 00000100:00100000:0.0:1789596813.767211:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789120 00000100:00100000:0.0:1789596813.767253:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596813.767259:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984789120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767306:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984789120:12345-0@lo:400:kworker.0 Request processed in 47us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.767312:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789596813.767346:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596813.767352:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596813.767354:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596813.767370:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788992 00000100:00100000:0.0:1789596813.767373:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788992 00000100:00100000:0.0:1789596813.767402:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788352 00000100:00100000:0.0:1789596813.767405:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788352 00000100:00100000:0.0:1789596813.767422:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788864 00000100:00100000:0.0:1789596813.767424:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788864 00000100:00100000:0.0:1789596813.767445:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789596813.767451:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984788992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767486:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984788992:12345-0@lo:400:kworker.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.767492:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789596813.767505:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789596813.767510:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984788352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767536:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984788352:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.767541:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789596813.767552:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789596813.767558:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984788864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767583:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984788864:12345-0@lo:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.767589:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1789596813.767601:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596813.767603:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596813.767625:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984788352:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767635:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984788864:0@lo:400:kworker.0 00010000:00080000:0.0:1789596813.767655:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb674ed80 x1876527984788992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596813.767665:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984788992:0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767749:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984788480 00000100:00100000:0.0:1789596813.767752:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984788480 00000100:00100000:0.0:1789596813.767780:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596813.767785:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984788480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596813.767820:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984788480:12345-0@lo:400:kworker.0 Request processed in 35us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596813.767826:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596813.767849:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984788480:0@lo:400:kworker.0 00010000:00080000:0.0:1789596813.767879:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb674e300 x1876527984789120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596813.767888:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984789120:0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.768191:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984787968 00000100:00100000:3.0:1789596813.768195:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984787968 00000100:00100000:3.0:1789596813.768237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789596813.768244:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:3645:x1876527984787968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596813.768289:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:3645:x1876527984787968:12345-0@lo:400:kworker.0 Request processed in 46us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596813.768295:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789596813.768341:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984787968:0@lo:400:kworker.0 00000020:00000080:1.0:1789596813.954532:0:13783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff28ff96b0 20000000:00000080:1.0:1789596813.954557:0:13783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7d83c81000 uarg=0000000000000000 20000000:01000000:1.0:1789596813.954609:0:13783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789596813.954616:0:13783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789596813.954622:0:13783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789596813.958603:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789596813.959158:0:13783:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789596813.959282:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789596813.959317:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789596813.959332:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789596813.959347:0:13783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789596813.959374:0:13783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959397:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959409:0:13783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959417:0:13783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959424:0:13783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959431:0:13783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959438:0:13783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596813.959443:0:13783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959453:0:13783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959467:0:13783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959489:0:13783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.959497:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbebce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.327250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596814.327766:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632000 00000100:00100000:2.0:1789596814.327781:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632000 00000100:00100000:2.0:1789596814.327854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 345 00000100:00100000:2.0:1789596814.327866:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+11:6180:x1876527961632000:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596814.327909:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596814.327936:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bbebd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078b2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.327974:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bbebd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078b2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.328423:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bbebd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078b2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.328446:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dde00, rc 0) 00000100:00100000:2.0:1789596814.328537:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961632000:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 671us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.328545:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 345 00000100:00100000:3.0:1789596814.334117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596814.337079:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632128 00000100:00100000:0.0:1789596814.337105:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632128 00000100:00100000:0.0:1789596814.337344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 346 00000100:00100000:0.0:1789596814.337358:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961632128:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596814.337592:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961632128:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 235us (3489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.337601:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 346 00000100:00100000:0.0:1789596814.342233:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596814.344209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632256 00000100:00100000:2.0:1789596814.344229:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632256 00000100:00100000:2.0:1789596814.344450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 347 00000100:00100000:2.0:1789596814.344464:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961632256:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596814.346022:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961632256:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 1545us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.346040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 347 00000100:00100000:1.0:1789596814.352858:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596814.353069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632384 00000100:00100000:0.0:1789596814.353085:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632384 00000100:00100000:0.0:1789596814.353178:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 348 00000100:00100000:0.0:1789596814.353190:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+12:10800:x1876527961632384:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789596814.353408:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+12:10800:x1876527961632384:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 219us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.353416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 348 00000100:00100000:0.0:1789596814.359103:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596814.359369:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632512 00000100:00100000:2.0:1789596814.359385:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632512 00000100:00100000:2.0:1789596814.359461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 349 00000100:00100000:2.0:1789596814.359473:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:10800:x1876527961632512:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596814.360611:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+12:10800:x1876527961632512:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 554us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.360637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 349 00000100:00100000:2.0:1789596814.366081:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596814.367206:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632640 00000100:00100000:3.0:1789596814.367225:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632640 00000100:00100000:2.0:1789596814.367823:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 350 00000100:00100000:2.0:1789596814.367838:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+12:6180:x1876527961632640:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596814.367864:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596814.367890:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833ddc00/0x7b5398e289bbebdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078b9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.367929:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833ddc00/0x7b5398e289bbebdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078b9 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.367943:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833ddc00/0x7b5398e289bbebdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078b9 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.367954:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833ddc00, rc 0) 00000100:00100000:2.0:1789596814.371257:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961632640:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 3393us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.371274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 350 00000100:00100000:1.0:1789596814.379389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596814.379522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632768 00000100:00100000:2.0:1789596814.379536:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632768 00000100:00100000:2.0:1789596814.379611:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:2.0:1789596814.379634:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961632768:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596814.379923:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961632768:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 300us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.379931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:3.0:1789596814.384145:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596814.384384:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961632896 00000100:00100000:2.0:1789596814.384416:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961632896 00000100:00100000:2.0:1789596814.384501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:2.0:1789596814.384513:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961632896:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596814.385115:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:6180:x1876527961632896:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 601us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.385125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:3.0:1789596814.388759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596814.389157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633024 00000100:00100000:0.0:1789596814.389174:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633024 00000100:00100000:0.0:1789596814.389258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 353 00000100:00100000:0.0:1789596814.389269:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:10803:x1876527961633024:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789596814.389476:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:10803:x1876527961633024:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 208us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.389485:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 353 00000100:00100000:1.0:1789596814.408383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596814.411565:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633152 00000100:00100000:3.0:1789596814.411589:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633152 00000100:00100000:3.0:1789596814.411703:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 354 00000100:00100000:3.0:1789596814.411740:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:10803:x1876527961633152:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596814.412005:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:10803:x1876527961633152:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 267us (3639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596814.412014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 354 10000000:01000000:1.0:1789596814.780968:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596814.780980:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebb0f4000 from 7 10000000:01000000:1.0:1789596814.780988:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596814.781063:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.781077:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.781090:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.781146:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.781250:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.781336:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596814.781633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789248 00000100:00100000:2.0:1789596814.781644:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789248 00000100:00100000:2.0:1789596814.781756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789596814.781768:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+20:6517:x1876527984789248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596814.781785:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596814.781802:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbebea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbebe3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.781832:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbebea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbebe3 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.781845:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbebea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbebe3 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596814.781854:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd400, rc 0) 00000100:00100000:2.0:1789596814.781918:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984789248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.781925:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789596814.782113:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596814.782132:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.782142:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.782226:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.782256:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.782288:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.782350:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789376 00000100:00100000:0.0:1789596814.782356:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789376 00000100:00100000:0.0:1789596814.782394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789596814.782402:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984789376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596814.782565:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984789376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.782572:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00010000:0.0:1789596814.782935:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596814.783966:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.784043:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.784139:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.784191:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.784265:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789504 00000100:00100000:0.0:1789596814.784274:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789504 00000100:00100000:0.0:1789596814.784340:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789596814.784352:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984789504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596814.784514:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984789504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.784529:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789596814.785986:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.787110:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13796:1876527984789632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.787227:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.787279:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596814.787354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789632 00000100:00100000:2.0:1789596814.787364:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789632 00000100:00100000:2.0:1789596814.787429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789596814.787440:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:13796:x1876527984789632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596814.787603:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+21:13796:x1876527984789632:12345-0@lo:502:llog_process_th.0 Request processed in 165us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596814.787612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789596814.792896:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13796:1876527984789632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596814.792967:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596814.793002:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.793005:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596814.793020:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7ebb0f4000 00000020:00000080:1.0:1789596814.793023:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596814.793118:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596814.793121:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.793123:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596814.793126:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596814.793128:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.793130:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789596814.793133:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7ebb0f4000 00000020:00000080:1.0:1789596814.793135:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789596814.793204:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13796:1876527984789760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.793303:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.793366:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596814.794452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789760 00000100:00100000:3.0:1789596814.794470:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789760 00000100:00100000:3.0:1789596814.794561:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789596814.794575:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:13796:x1876527984789760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596814.794828:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+21:13796:x1876527984789760:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596814.794836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789596814.794983:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13796:1876527984789760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596814.795022:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596814.795031:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.795033:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789596814.795045:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789596814.795347:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789596814.795387:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596814.795399:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596814.795413:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596814.795426:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789596814.795430:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebaf79000 from 7 10000000:01000000:3.0:1789596814.795433:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596814.795471:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596814.795481:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596814.795491:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596814.795516:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596814.795563:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596814.798841:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.804927:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984789888 00000100:00100000:0.0:1789596814.804952:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984789888 00000100:00100000:0.0:1789596814.805895:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789596814.805916:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+21:6517:x1876527984789888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596814.805943:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596814.805970:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbebf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbebf1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.806014:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbebf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbebf1 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.806028:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbebf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbebf1 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.806039:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743a00, rc 0) 00000100:00100000:0.0:1789596814.806167:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984789888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (10604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.806175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789596814.807037:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984789888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596814.807065:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596814.807077:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596814.807185:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596814.807252:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596814.824110:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.827603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790016 00000100:00100000:1.0:1789596814.827627:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790016 00000100:00100000:1.0:1789596814.827850:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789596814.827864:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984790016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.828100:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984790016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (20846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.828107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789596814.828181:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.828253:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.828328:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.828365:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.828379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790144 00000100:00100000:1.0:1789596814.828383:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790144 00000100:00100000:1.0:1789596814.828401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789596814.828406:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984790144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.828492:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984790144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.828499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789596814.828542:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.828813:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13799:1876527984790272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.828850:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.828868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790272 00000100:00100000:1.0:1789596814.828872:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790272 00000100:00100000:1.0:1789596814.828887:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789596814.828893:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:13799:x1876527984790272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.828964:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:13799:x1876527984790272:12345-0@lo:502:llog_process_th.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.828971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789596814.828997:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.829010:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13799:1876527984790272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596814.829030:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596814.829043:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.829045:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596814.829054:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7ebaf79000 00000020:00000080:1.0:1789596814.829061:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596814.829139:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596814.829143:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.829145:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596814.829147:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596814.829150:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.829152:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789596814.829155:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7ebaf79000 00000020:00000080:1.0:1789596814.829157:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789596814.829188:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13799:1876527984790400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.829220:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.829238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790400 00000100:00100000:1.0:1789596814.829242:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790400 00000100:00100000:1.0:1789596814.829259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789596814.829265:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:13799:x1876527984790400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.829321:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:13799:x1876527984790400:12345-0@lo:502:llog_process_th.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.829328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789596814.829354:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.829364:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13799:1876527984790400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596814.829381:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596814.829385:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596814.829387:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789596814.829391:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789596814.829464:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789596814.829493:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596814.829504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829527:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596814.829539:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596814.829542:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb9a66000 from 7 10000000:01000000:1.0:1789596814.829545:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596814.829572:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829581:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829590:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.829602:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.829629:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.829642:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.829654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790528 00000100:00100000:1.0:1789596814.829657:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790528 00000100:00100000:1.0:1789596814.829674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789596814.829716:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+22:6517:x1876527984790528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596814.829726:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596814.829741:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb64c6600/0x7b5398e289bbec06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbebff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829767:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb64c6600/0x7b5398e289bbec06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbebff expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829790:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb64c6600/0x7b5398e289bbec06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbebff expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829801:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c6600, rc 0) 00000100:00100000:1.0:1789596814.829830:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984790528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.829836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789596814.829865:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596814.829877:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.829887:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.829933:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.829958:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.829971:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.829981:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790656 00000100:00100000:1.0:1789596814.829985:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790656 00000100:00100000:1.0:1789596814.830001:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789596814.830007:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984790656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.830101:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984790656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.830107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789596814.830135:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.830168:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.830199:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.830210:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.830221:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790784 00000100:00100000:1.0:1789596814.830224:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790784 00000100:00100000:1.0:1789596814.830241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789596814.830245:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984790784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.830308:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984790784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.830315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789596814.830349:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984790784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.830611:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13800:1876527984790912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.830645:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.830663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984790912 00000100:00100000:1.0:1789596814.830666:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984790912 00000040:00080000:3.0:1789596814.843535:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789596814.843939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789596814.843962:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:13800:x1876527984790912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.844185:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:13800:x1876527984790912:12345-0@lo:502:llog_process_th.0 Request processed in 233us (13537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.844195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789596814.849162:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.849233:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13800:1876527984790912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596814.849293:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596814.849306:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596814.849309:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789596814.849319:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7eb9a66000 00000020:00000080:0.0:1789596814.849324:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789596814.849397:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596814.849402:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596814.849410:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789596814.849414:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596814.849417:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596814.849418:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789596814.849422:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7eb9a66000 00000020:00000080:0.0:1789596814.849425:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789596814.849509:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13800:1876527984791040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596814.849606:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596814.849655:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791040 00000100:00100000:0.0:1789596814.849665:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791040 00000100:00100000:1.0:1789596814.849773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789596814.849788:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:13800:x1876527984791040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.849950:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+23:13800:x1876527984791040:12345-0@lo:502:llog_process_th.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.849968:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789596814.850023:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d837649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.850041:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13800:1876527984791040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596814.850065:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596814.850070:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596814.850072:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789596814.850075:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789596814.850196:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789596814.850229:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596814.850242:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.850256:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596814.850269:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596814.850273:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e867d5800 from 7 10000000:01000000:1.0:1789596814.850276:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596814.850317:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.850326:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.850335:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.850350:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984791168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.850394:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.850419:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.850485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791168 00000100:00100000:0.0:1789596814.850490:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791168 00000100:00100000:0.0:1789596814.850524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789596814.850533:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+23:6517:x1876527984791168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596814.850544:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596814.850560:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbec14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbec0d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.850589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbec14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbec0d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.850601:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbec14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbec0d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.850623:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743000, rc 0) 00000100:00100000:0.0:1789596814.850663:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984791168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.850669:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789596814.850772:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984791168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596814.850786:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596814.850796:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596814.850866:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984791296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.850894:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596814.850966:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596814.851083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791296 00000100:00100000:0.0:1789596814.851088:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791296 00000100:00100000:0.0:1789596814.851159:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789596814.851166:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984791296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596814.851904:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984791296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 734us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596814.851915:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789596814.852003:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984791296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596814.852051:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984791424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596814.852103:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596814.852312:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.852446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791424 00000100:00100000:1.0:1789596814.852453:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791424 00000100:00100000:1.0:1789596814.852493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789596814.852502:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984791424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596814.852620:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:6517:x1876527984791424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.852627:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789596814.852672:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d576172c-8178-43f9-add9-c496dd76058d:6517:1876527984791424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596814.852968:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13803:1876527984791552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596814.853016:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596814.853046:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e98151cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.853119:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791552 00000100:00100000:1.0:1789596814.853124:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791552 00000100:00100000:1.0:1789596814.853149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789596814.853155:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:13803:x1876527984791552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.853258:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:13803:x1876527984791552:12345-0@lo:502:llog_process_th.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.853265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789596814.853473:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13803:1876527984791552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596814.853501:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596814.853514:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596814.853517:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789596814.853525:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7e867d5800 00000020:00000080:2.0:1789596814.853528:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596814.853605:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596814.853609:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596814.853610:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789596814.853613:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596814.853616:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596814.853617:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789596814.853621:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7e867d5800 00000020:00000080:2.0:1789596814.853624:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789596814.853657:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13803:1876527984791680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596814.853733:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596814.853756:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596814.854206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791680 00000100:00100000:1.0:1789596814.854213:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791680 00000100:00100000:1.0:1789596814.854244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789596814.854251:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:13803:x1876527984791680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596814.854724:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:13803:x1876527984791680:12345-0@lo:502:llog_process_th.0 Request processed in 471us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596814.854743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789596814.855225:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d576172c-8178-43f9-add9-c496dd76058d:13803:1876527984791680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596814.855640:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596814.855653:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596814.855655:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789596814.855659:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789596814.856455:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789596814.856488:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596814.856504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596814.856520:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596814.864273:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596815.293148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984791808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596815.293232:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596815.293368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791808 00000100:00100000:1.0:1789596815.293378:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791808 00000100:00100000:1.0:1789596815.293449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789596815.293460:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984791808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596815.293508:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596815.293563:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984791808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596815.293570:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789596815.293667:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984791808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596815.354674:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596815.354760:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596815.354845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633280 00000100:00100000:2.0:1789596815.354855:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633280 00000100:00100000:2.0:1789596815.354918:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 375 00000100:00100000:2.0:1789596815.354929:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961633280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596815.355120:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961633280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 191us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596815.355128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 375 00000100:00100000:3.0:1789596815.355730:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633408 00000100:00100000:3.0:1789596815.355737:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633408 00000100:00080000:0.0:1789596815.355807:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596815.355948:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:3.0:1789596815.355968:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961633408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596815.356182:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961633408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 217us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596815.356190:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:2.0:1789596815.356293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596815.356376:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596815.356557:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596815.356582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596815.363873:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633536 00000100:00100000:3.0:1789596815.363892:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633536 00000100:00080000:2.0:1789596815.364042:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596815.364082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633792 00000100:00100000:3.0:1789596815.364087:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633792 00000100:00100000:3.0:1789596815.364119:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633920 00000100:00100000:3.0:1789596815.364122:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633920 00000100:00100000:3.0:1789596815.364145:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:3.0:1789596815.364155:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961633536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596815.364250:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961633536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 96us (7956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596815.364259:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:3.0:1789596815.364277:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:3.0:1789596815.364284:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961633792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596815.364326:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961633792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 42us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596815.364332:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:3.0:1789596815.364345:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:3.0:1789596815.364351:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961633920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596815.364373:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961633920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (7790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596815.364569:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:3.0:1789596815.364610:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961633664 00000100:00100000:3.0:1789596815.364615:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961633664 00000100:00080000:2.0:1789596815.364866:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596815.364869:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596815.364871:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596815.365480:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1789596815.365583:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961633664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596815.365649:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961633664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 71us (9092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596815.365657:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00010000:00010000:2.0:1789596815.805513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596815.870297:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789596815.871100:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789596816.830676:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596817.340913:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984791936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596817.340983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596817.341051:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984791936 00000100:00100000:1.0:1789596817.341058:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984791936 00000100:00100000:1.0:1789596817.341096:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789596817.341106:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984791936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596817.341153:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596817.341200:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984791936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596817.341207:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789596817.341250:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984791936:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596817.853054:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596818.365140:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984792064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596818.365227:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.365767:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792064 00000100:00100000:2.0:1789596818.365776:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792064 00000100:00100000:2.0:1789596818.365846:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789596818.365856:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984792064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596818.365883:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596818.365934:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984792064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596818.365951:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1789596818.368539:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596818.368610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984792064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596818.369093:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596818.369106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984792192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596818.369177:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596818.369484:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792192 00000100:00100000:1.0:1789596818.369492:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792192 00000100:00100000:1.0:1789596818.369559:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789596818.369568:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984792192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596818.369588:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596818.369649:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984792192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596818.369656:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789596818.369720:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984792192:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789596818.371222:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789596818.374402:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789596818.877496:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596818.877523:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984792704:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.877578:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984792448:0@lo:400:kworker.0 00000100:00100000:0.0:1789596818.877615:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596818.877625:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.877709:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984792832:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.877755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.877892:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792832 00000100:00100000:2.0:1789596818.877910:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792832 00000100:00100000:2.0:1789596818.877967:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789596818.877975:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984792832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.878239:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984792960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.878268:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.878708:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984792832:12345-0@lo:400:kworker.0 Request processed in 693us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596818.878730:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789596818.879066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984793472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879109:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596818.879137:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789596818.879143:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984792576:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596818.879184:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984793088:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879202:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596818.879221:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984793600:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596818.879315:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793600 00000100:00100000:3.0:1789596818.879321:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793600 00000100:00100000:3.0:1789596818.879370:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789596818.879378:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984793600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879427:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984793600:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.879433:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789596818.879456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792704 00000100:00100000:3.0:1789596818.879460:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792704 00000100:00100000:3.0:1789596818.879483:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792960 00000100:00100000:3.0:1789596818.879486:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792960 00000100:00100000:3.0:1789596818.879499:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789596818.879504:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984792704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879538:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984792704:12345-0@lo:400:kworker.0 Request processed in 33us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.879544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789596818.879555:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789596818.879561:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984792960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879586:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984792960:12345-0@lo:400:kworker.0 Request processed in 25us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.879592:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1789596818.879606:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789596818.879929:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837ba300 x1876527984793600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596818.879943:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984793600:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.879968:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984792960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.880006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793472 00000100:00100000:3.0:1789596818.880010:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793472 00000100:00100000:3.0:1789596818.880037:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792576 00000100:00100000:3.0:1789596818.880040:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792576 00000100:00100000:3.0:1789596818.880053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793088 00000100:00100000:3.0:1789596818.880056:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793088 00000100:00100000:3.0:1789596818.880069:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789596818.880075:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984793472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.880111:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984793472:12345-0@lo:400:kworker.0 Request processed in 36us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.880117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789596818.880128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789596818.880133:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984792576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.880157:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984792576:12345-0@lo:400:kworker.0 Request processed in 24us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.880162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789596818.880171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789596818.880176:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.880198:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984793088:12345-0@lo:400:kworker.0 Request processed in 22us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.880204:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:3.0:1789596818.880216:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596818.880219:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596818.880237:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984792576:0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.880246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984793088:0@lo:400:kworker.0 00010000:00080000:3.0:1789596818.880265:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837bbb80 x1876527984793472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596818.880274:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984793472:0@lo:400:kworker.0 00010000:00010000:3.0:1789596818.880315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596818.880354:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792448 00000100:00100000:3.0:1789596818.880358:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792448 00000100:00100000:3.0:1789596818.880383:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789596818.880389:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596818.880423:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984792448:12345-0@lo:400:kworker.0 Request processed in 34us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.880430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789596818.880461:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984792448:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.880833:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984792832:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.880844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984793344:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.880878:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.880928:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984793856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596818.880955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.880986:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789596818.880992:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984793216:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.881014:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.881033:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984793728:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.881053:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596818.881082:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793728 00000100:00100000:2.0:1789596818.881086:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793728 00000100:00100000:2.0:1789596818.881126:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789596818.881132:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984793728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.881183:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984793728:12345-0@lo:400:kworker.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596818.881190:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789596818.881209:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596818.881218:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793344 00000100:00100000:2.0:1789596818.881222:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793344 00000100:00100000:2.0:1789596818.881248:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793216 00000100:00100000:2.0:1789596818.881251:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793216 00000100:00100000:2.0:1789596818.881269:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789596818.881274:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984793344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.881315:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984793344:12345-0@lo:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596818.881321:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789596818.881332:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789596818.881337:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984793216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.881361:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984793216:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596818.881367:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:2.0:1789596818.881381:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596818.881383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789596818.881402:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837b9880 x1876527984793216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596818.881413:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984793216:0@lo:400:kworker.0 00010000:00080000:2.0:1789596818.881422:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837ba680 x1876527984793728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596818.881431:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984793728:0@lo:400:kworker.0 00000100:00100000:2.0:1789596818.881451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984793344:0@lo:400:kworker.0 00000100:00100000:1.0:1789596818.881725:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793856 00000100:00100000:1.0:1789596818.881730:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793856 00000100:00100000:1.0:1789596818.881768:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789596818.881775:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984793856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596818.881823:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596818.881864:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984793856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596818.881871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1789596818.882081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67c4700 x1876527984793856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596818.882096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984793856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596818.885514:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984792704:0@lo:400:kworker.0 00000100:00100000:0.0:1789596818.885533:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984792320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596818.888514:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596818.888886:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984792320 00000100:00100000:3.0:1789596818.888897:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984792320 00000100:00100000:3.0:1789596818.888955:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789596818.888965:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984792320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596818.888989:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596818.889058:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984792320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596818.889065:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789596818.890769:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd7100 x1876527984792320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596818.890801:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984792320:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789596819.900899:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596820.413003:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596820.413038:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984793984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596820.413133:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596820.413286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984793984 00000100:00100000:1.0:1789596820.413298:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984793984 00000100:00100000:1.0:1789596820.413362:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596820.413374:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984793984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596820.413429:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596820.413542:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984793984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596820.413549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789596820.416101:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984793984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596820.473379:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596820.473432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596820.473469:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596820.473516:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596820.473549:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634176 00000100:00100000:2.0:1789596820.473559:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634176 00000100:00100000:2.0:1789596820.473617:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634688 00000100:00100000:2.0:1789596820.473620:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634688 00000100:00100000:2.0:1789596820.473646:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 259 00000100:00100000:2.0:1789596820.473669:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961634176:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596820.473885:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634432 00000100:00100000:0.0:1789596820.473891:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634432 00000100:00100000:0.0:1789596820.473925:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789596820.473933:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961634432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596820.473993:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961634432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 60us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596820.474001:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789596820.474023:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634048 00000100:00100000:0.0:1789596820.474027:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634048 00000100:00100000:0.0:1789596820.474049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:0.0:1789596820.474055:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961634048:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596820.474081:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961634048:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596820.474088:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:0.0:1789596820.474252:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 260 00000100:00100000:0.0:1789596820.474259:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961634688:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596820.474288:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961634688:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596820.474293:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 260 00000100:00080000:0.0:1789596820.474309:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596820.474313:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596820.474315:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596820.474460:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961634176:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 805us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596820.474468:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 259 00000100:00100000:0.0:1789596820.482263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596820.482303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596820.482451:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634304 00000100:00100000:2.0:1789596820.482461:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634304 00000100:00100000:2.0:1789596820.482554:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634560 00000100:00100000:2.0:1789596820.482557:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634560 00000100:00100000:2.0:1789596820.482595:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 261 00000100:00100000:2.0:1789596820.482669:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961634304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596820.482797:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961634304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 192us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596820.484765:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 262 00000100:00100000:1.0:1789596820.484793:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961634560:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596820.485108:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961634560:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 93us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596820.485119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 262 00000100:00080000:0.0:1789596820.485350:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596820.485358:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596820.501454:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 261 00010000:00010000:0.0:1789596820.925167:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596821.948949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596822.461076:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984794112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596822.461156:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596822.462210:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794112 00000100:00100000:1.0:1789596822.462237:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794112 00000100:00100000:1.0:1789596822.462299:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789596822.462309:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984794112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596822.462345:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596822.462423:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984794112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596822.462430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789596822.462717:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984794112:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596822.974057:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596823.484961:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984794240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596823.485039:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596823.485150:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794240 00000100:00100000:0.0:1789596823.485158:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794240 00000100:00100000:0.0:1789596823.485216:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789596823.485226:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984794240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596823.485262:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789596823.485304:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596823.485313:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984794240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596823.485322:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789596823.485366:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984794240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596823.487806:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596823.487843:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984794368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596823.487924:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.488258:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794368 00000100:00100000:1.0:1789596823.488268:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794368 00000100:00100000:1.0:1789596823.488354:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789596823.488365:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984794368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596823.488391:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596823.488444:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984794368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.488451:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789596823.488499:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789596823.488504:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7eb674fb80, transno 4294967301 00000100:00100000:1.0:1789596823.488521:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984794368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596823.489292:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596823.997049:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596823.997073:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984794496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596823.997149:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596823.998054:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596823.998442:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984795008:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998535:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984795520:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998558:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998581:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789596823.998587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984794624:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998614:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998726:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984795136:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998770:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984795648:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998792:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998817:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984794752:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998857:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984795264:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998876:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998889:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984795776:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998938:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789596823.998944:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984794880:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.998981:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.998997:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984795392:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999016:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596823.999038:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795008 00000100:00100000:1.0:1789596823.999047:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795008 00000100:00100000:1.0:1789596823.999082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795520 00000100:00100000:1.0:1789596823.999085:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795520 00000100:00100000:1.0:1789596823.999105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795648 00000100:00100000:1.0:1789596823.999108:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795648 00000100:00100000:1.0:1789596823.999119:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794752 00000100:00100000:1.0:1789596823.999121:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794752 00000100:00100000:1.0:1789596823.999131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795264 00000100:00100000:1.0:1789596823.999133:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795264 00000100:00100000:1.0:1789596823.999144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795392 00000100:00100000:1.0:1789596823.999146:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795392 00000100:00100000:1.0:1789596823.999160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789596823.999176:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984795008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999245:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984795008:12345-0@lo:400:kworker.0 Request processed in 70us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999253:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789596823.999270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789596823.999276:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984795520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999301:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984795520:12345-0@lo:400:kworker.0 Request processed in 26us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789596823.999318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789596823.999323:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984795648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999347:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984795648:12345-0@lo:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999353:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789596823.999362:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789596823.999367:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984794752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999393:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984794752:12345-0@lo:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999397:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789596823.999404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789596823.999407:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984795264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999422:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984795264:12345-0@lo:400:kworker.0 Request processed in 15us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789596823.999430:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789596823.999441:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984795392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999467:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984795392:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789596823.999502:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795136 00000100:00100000:1.0:1789596823.999507:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795136 00000100:00100000:1.0:1789596823.999523:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794880 00000100:00100000:1.0:1789596823.999525:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794880 00000100:00100000:1.0:1789596823.999537:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596823.999543:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984795136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999574:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984795136:12345-0@lo:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999580:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596823.999590:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789596823.999596:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984794880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999633:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984794880:12345-0@lo:400:kworker.0 Request processed in 37us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999639:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789596823.999702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984794880:0@lo:400:kworker.0 00000100:00100000:3.0:1789596823.999708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794624 00010000:00080000:1.0:1789596823.999716:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212d80 x1876527984795392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596823.999724:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794624 00000100:00100000:1.0:1789596823.999726:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984795392:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999735:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984794752:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999743:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984795264:0@lo:400:kworker.0 00000100:00100000:3.0:1789596823.999750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789596823.999761:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984794624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999784:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984795136:0@lo:400:kworker.0 00010000:00080000:1.0:1789596823.999795:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212680 x1876527984795648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596823.999802:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb02b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984794624:12345-0@lo:400:kworker.0 Request processed in 42us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596823.999803:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984795648:0@lo:400:kworker.0 00000100:00100000:3.0:1789596823.999809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789596823.999812:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984795008:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999820:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984795520:0@lo:400:kworker.0 00000100:00100000:1.0:1789596823.999836:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984794624:0@lo:400:kworker.0 00000100:00100000:0.0:1789596823.999971:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984794496 00000100:00100000:0.0:1789596823.999976:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984794496 00000100:00100000:0.0:1789596824.000008:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789596824.000015:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984794496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596824.000049:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596824.000090:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984794496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596824.000097:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789596824.000106:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795776 00000100:00100000:2.0:1789596824.000111:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795776 00000100:00080000:0.0:1789596824.000119:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596824.000123:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596824.000125:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596824.000139:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789596824.000145:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984795776:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789596824.000179:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67c6d80 x1876527984794496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596824.000195:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984795776:12345-0@lo:400:kworker.0 Request processed in 39us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596824.000195:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984794496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596824.000201:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1789596824.000229:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb211180 x1876527984795776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596824.000239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984795776:0@lo:400:kworker.0 00000100:00100000:3.0:1789596824.000394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984795904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596824.000422:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596824.000487:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984795904 00000100:00100000:0.0:1789596824.000492:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984795904 00000100:00100000:0.0:1789596824.000525:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789596824.000532:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984795904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596824.000542:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596824.000708:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984795904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596824.000726:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:3.0:1789596824.000818:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd1f80 x1876527984795904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596824.000831:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984795904:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789596825.023381:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596825.086552:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789596825.087675:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789596825.532980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984796032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596825.533059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596825.533290:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796032 00000100:00100000:2.0:1789596825.533300:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796032 00000100:00100000:2.0:1789596825.533353:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789596825.533364:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984796032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596825.533400:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596825.533458:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984796032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596825.533479:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789596825.533591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984796032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596825.598585:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596825.598878:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634816 00000100:00100000:3.0:1789596825.598889:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634816 00000100:00100000:0.0:1789596825.598987:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596825.599028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596825.599062:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635072 00000100:00100000:0.0:1789596825.599066:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635072 00000100:00100000:0.0:1789596825.599105:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961634944 00000100:00100000:0.0:1789596825.599119:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961634944 00000100:00100000:0.0:1789596825.599145:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 269 00000100:00100000:0.0:1789596825.599155:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961635072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596825.599230:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961635072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596825.599238:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 269 00000100:00100000:0.0:1789596825.599254:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 270 00000100:00100000:0.0:1789596825.599260:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961634944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596825.599286:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961634944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596825.599309:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 270 00000100:00080000:0.0:1789596825.599327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596825.599331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596825.599668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:3.0:1789596825.599697:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961634816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596825.599738:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961634816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 62us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596825.599745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:0.0:1789596825.602433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596825.602656:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635200 00000100:00100000:3.0:1789596825.602665:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635200 00000100:00100000:3.0:1789596825.602766:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00080000:0.0:1789596825.602983:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596825.603045:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2405:x1876527961635200:12345-192.168.202.16@tcp:9:kworker.0 00000100:00100000:0.0:1789596825.603053:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596825.603098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000020:00000080:3.0:1789596825.603117:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbeb3b 00000100:00100000:0.0:1789596825.603123:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635328 00000100:00100000:0.0:1789596825.603129:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635328 00000100:00080000:3.0:1789596825.603136:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c2f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789596825.603175:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635456 00000100:00100000:0.0:1789596825.603181:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635456 00000100:00100000:0.0:1789596825.603211:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:0.0:1789596825.603222:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961635328:12345-192.168.202.16@tcp:400:kworker.0 00000001:00000004:3.0:1789596825.603236:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789596825.603318:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961635328:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596825.603327:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:0.0:1789596825.603351:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 272 00000100:00100000:0.0:1789596825.603363:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961635456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596825.603390:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961635456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596825.603397:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 272 00000100:00100000:3.0:1789596825.603482:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+2:2405:x1876527961635200:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 452us (1069us total) trans 0 rc 0/0 00010000:00010000:2.0:1789596825.603566:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596825.603584:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596825.603588:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596825.621224:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00010000:00010000:1.0:1789596826.045294:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596827.068948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596827.584768:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596827.584800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984796160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596827.584880:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596827.585071:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796160 00000100:00100000:1.0:1789596827.585081:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796160 00000100:00100000:1.0:1789596827.585136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789596827.585146:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984796160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596827.585196:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596827.585254:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984796160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596827.585263:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789596827.585382:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984796160:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789596828.093999:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596828.606138:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596828.606258:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596828.606431:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796288 00000100:00100000:1.0:1789596828.606444:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796288 00000100:00100000:1.0:1789596828.606537:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789596828.606550:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984796288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596828.606602:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596828.606668:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984796288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596828.606705:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789596828.606805:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984796288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789596828.607017:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596828.608063:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596828.608087:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984796416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596828.608171:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596828.608480:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796416 00000100:00100000:3.0:1789596828.608489:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796416 00000100:00100000:3.0:1789596828.608563:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789596828.608573:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984796416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596828.608613:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596828.608715:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984796416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596828.608722:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789596828.608775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984796416:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789596828.609263:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596829.117062:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984796672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596829.117135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984796544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596829.117174:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596829.117199:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796672 00000100:00100000:3.0:1789596829.117209:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796672 00000100:00080000:0.0:1789596829.117268:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596829.117276:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789596829.117288:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984796672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596829.117327:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1789596829.117336:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596829.117408:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984796672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596829.117415:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789596829.117442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789596829.117543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb674df80 x1876527984796672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596829.117586:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984796672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596829.117795:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796544 00000100:00100000:1.0:1789596829.117800:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796544 00000100:00100000:1.0:1789596829.117829:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789596829.117835:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984796544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596829.117847:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596829.117883:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984796544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596829.117889:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1789596829.120667:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596829.120816:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83cd1f80 x1876527984796544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596829.120848:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984796544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596829.121279:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984797184:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.121366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596829.121366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984796928:0@lo:400:kworker.0 00000100:00100000:1.0:1789596829.121400:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596829.121413:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984797696:0@lo:400:kworker.0 00000100:00100000:1.0:1789596829.121419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984797440:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.121434:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596829.121465:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789596829.121471:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984797056:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.121499:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596829.121520:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984797568:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.121542:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596829.121992:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984796800:0@lo:400:kworker.0 00000100:00100000:0.0:1789596829.122039:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596829.122069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984797312:0@lo:400:kworker.0 00000100:00100000:0.0:1789596829.122094:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596829.122113:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984797824:0@lo:400:kworker.0 00000100:00100000:0.0:1789596829.122146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796800 00000100:00100000:0.0:1789596829.122155:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796800 00000100:00100000:0.0:1789596829.122211:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789596829.122221:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984796800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596829.122281:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e99161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984796800:12345-0@lo:400:kworker.0 Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596829.122289:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789596829.122349:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797056 00000100:00100000:0.0:1789596829.122353:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797056 00000100:00100000:0.0:1789596829.122373:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797312 00000100:00100000:0.0:1789596829.122376:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797312 00000100:00100000:0.0:1789596829.122390:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789596829.122396:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984797056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596829.122432:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984797056:12345-0@lo:400:kworker.0 Request processed in 37us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596829.122455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789596829.122469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789596829.122474:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984797312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596829.122525:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984797312:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596829.122531:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789596829.123779:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797184 00000100:00100000:1.0:1789596829.123792:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797184 00000100:00100000:2.0:1789596829.123827:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984797056:0@lo:400:kworker.0 00000100:00100000:1.0:1789596829.123846:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984796928 00000100:00100000:1.0:1789596829.123849:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984796928 00000100:00100000:1.0:1789596829.123861:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797696 00000100:00100000:1.0:1789596829.123864:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797696 00000100:00100000:2.0:1789596829.123868:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797568 00000100:00100000:2.0:1789596829.123871:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797568 00000100:00100000:1.0:1789596829.123893:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789596829.123901:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984797184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.123903:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789596829.123909:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984796928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.123975:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984796928:12345-0@lo:400:kworker.0 Request processed in 65us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596829.123979:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984797184:12345-0@lo:400:kworker.0 Request processed in 80us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596829.123983:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789596829.123985:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789596829.124000:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789596829.124003:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789596829.124007:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984797696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596829.124008:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984797568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.124035:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984797696:12345-0@lo:400:kworker.0 Request processed in 30us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596829.124035:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984797568:12345-0@lo:400:kworker.0 Request processed in 26us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596829.124041:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789596829.124047:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1789596829.124063:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596829.124066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789596829.124067:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596829.124104:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984796928:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.124121:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797440 00000100:00100000:2.0:1789596829.124124:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797440 00000100:00100000:2.0:1789596829.124149:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789596829.124156:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984797440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596829.124179:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596829.124188:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984797440:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596829.124194:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789596829.124206:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797824 00000100:00100000:2.0:1789596829.124209:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797824 00000100:00100000:1.0:1789596829.124216:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984796800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596829.124230:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984797312:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.124231:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789596829.124236:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984797824:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789596829.124256:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596829.124268:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984797824:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596829.124273:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:1.0:1789596829.124277:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb6745c00 x1876527984797824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596829.124289:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984797824:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.124296:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984797440:0@lo:400:kworker.0 00010000:00080000:2.0:1789596829.124327:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb6746680 x1876527984797568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596829.124336:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984797568:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.124348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984797184:0@lo:400:kworker.0 00000100:00100000:2.0:1789596829.124358:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984797696:0@lo:400:kworker.0 00010000:00010000:0.0:1789596830.141953:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596830.653249:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596830.653291:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984797952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596830.653396:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596830.653798:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984797952 00000100:00100000:2.0:1789596830.653810:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984797952 00000100:00100000:2.0:1789596830.653884:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789596830.653896:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984797952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596830.653945:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596830.654026:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984797952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596830.654035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789596830.654210:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984797952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596830.718207:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596830.718274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596830.718337:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596830.718364:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596830.718388:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596830.718431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635712 00000100:00100000:0.0:1789596830.718444:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635712 00000100:00100000:0.0:1789596830.718517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635840 00000100:00100000:0.0:1789596830.718520:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635840 00000100:00100000:0.0:1789596830.718536:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636096 00000100:00100000:0.0:1789596830.718539:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636096 00000100:00100000:0.0:1789596830.718553:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635968 00000100:00100000:0.0:1789596830.718555:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635968 00000100:00100000:0.0:1789596830.718587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 279 00000100:00100000:0.0:1789596830.718598:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961635712:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596830.718742:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961635712:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 145us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596830.718751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 279 00000100:00100000:0.0:1789596830.718771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 280 00000100:00100000:0.0:1789596830.718778:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961635840:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596830.718817:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961635840:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596830.718824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 280 00000100:00100000:0.0:1789596830.718836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:0.0:1789596830.718843:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961636096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596830.718869:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961636096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596830.718875:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:0.0:1789596830.718887:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 282 00000100:00100000:0.0:1789596830.718894:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961635968:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596830.718921:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961635968:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596830.718927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 282 00000100:00100000:3.0:1789596830.719296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961635584 00000100:00100000:3.0:1789596830.719303:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961635584 00000100:00100000:3.0:1789596830.719344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 381 00000100:00100000:3.0:1789596830.719352:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961635584:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596830.719401:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e930d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961635584:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 49us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596830.719407:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 381 00000100:00080000:1.0:1789596830.720025:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596830.720033:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789596831.165203:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789596831.168282:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:3.0:1789596831.168295:0:8430:0:(genops.c:885:class_export_put()) final put ffff9c7d83c2f000/2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:2.0:1789596831.169589:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c2f000/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-OST0000 00000020:00000080:2.0:1789596831.169716:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c2f800 for lustre-OST0000 00010000:00010000:1.0:1789596832.189328:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596832.701308:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596832.701355:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984798080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596832.701451:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596832.705663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798080 00000100:00100000:3.0:1789596832.705812:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798080 00000100:00100000:3.0:1789596832.706002:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789596832.706028:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984798080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596832.706095:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789596832.706226:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984798080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 212us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596832.706233:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789596832.706364:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984798080:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596833.216587:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596833.725329:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596833.725358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984798208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596833.725482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596833.725816:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798208 00000100:00100000:1.0:1789596833.725827:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798208 00000100:00100000:1.0:1789596833.725912:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789596833.725924:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984798208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789596833.725965:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596833.726029:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984798208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596833.726037:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1789596833.726201:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596833.726253:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984798208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596833.726786:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596833.726801:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984798336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596833.726849:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596833.726938:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798336 00000100:00100000:2.0:1789596833.726944:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798336 00000100:00100000:2.0:1789596833.727001:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789596833.727009:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984798336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596833.727037:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596833.727080:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984798336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596833.727086:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789596833.727120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984798336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596833.727583:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596834.237112:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984798592:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.237219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.237294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984799104:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.237320:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.237339:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984799616:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.237361:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.237398:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789596834.237405:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984798720:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.237459:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.237484:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984799232:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.237509:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.237553:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984799744:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.237579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.237920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984798848:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.237956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.237978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984799360:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.237999:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.238020:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984799872:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.238044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.238064:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789596834.238071:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984798464:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.238104:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.238128:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984798976:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.238170:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.238194:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984799488:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.238216:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596834.238237:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984800000:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.238257:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596834.238438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798464 00000100:00100000:0.0:1789596834.238457:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798464 00000100:00100000:0.0:1789596834.238523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789596834.238543:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984798464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596834.238614:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984798464:12345-0@lo:400:kworker.0 Request processed in 72us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596834.238622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789596834.238660:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799360 00000100:00100000:0.0:1789596834.238663:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799360 00000100:00100000:0.0:1789596834.238701:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799872 00000100:00100000:0.0:1789596834.238705:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799872 00000100:00100000:0.0:1789596834.238727:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799488 00000100:00100000:0.0:1789596834.238729:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799488 00000100:00100000:0.0:1789596834.238741:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800000 00000100:00100000:0.0:1789596834.238744:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800000 00000100:00100000:0.0:1789596834.238759:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596834.238766:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984799360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596834.238801:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984799360:12345-0@lo:400:kworker.0 Request processed in 35us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596834.238808:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596834.238820:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789596834.238826:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984799872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596834.238856:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984799872:12345-0@lo:400:kworker.0 Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596834.238862:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789596834.238874:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789596834.238880:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984799488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596834.238908:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984799488:12345-0@lo:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596834.238926:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789596834.238937:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596834.238944:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984800000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596834.238970:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984800000:12345-0@lo:400:kworker.0 Request processed in 27us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596834.238976:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789596834.238999:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596834.239074:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596834.239088:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984800128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596834.239126:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.239160:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798592 00000100:00100000:2.0:1789596834.239165:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798592 00000100:00100000:2.0:1789596834.239191:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799104 00000100:00100000:2.0:1789596834.239195:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799104 00000100:00100000:2.0:1789596834.239229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799616 00000100:00100000:2.0:1789596834.239233:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799616 00000100:00100000:2.0:1789596834.239249:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799232 00000100:00100000:2.0:1789596834.239253:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799232 00000100:00100000:2.0:1789596834.239269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984799744 00000100:00100000:2.0:1789596834.239272:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984799744 00000100:00100000:2.0:1789596834.239288:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798848 00000100:00100000:2.0:1789596834.239291:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798848 00000100:00100000:2.0:1789596834.239306:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789596834.239312:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984798592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239348:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984798592:12345-0@lo:400:kworker.0 Request processed in 36us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239354:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789596834.239368:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789596834.239375:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984799104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239401:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984799104:12345-0@lo:400:kworker.0 Request processed in 27us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239406:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789596834.239415:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789596834.239420:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984799616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239446:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984799616:12345-0@lo:400:kworker.0 Request processed in 26us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239452:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789596834.239462:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789596834.239468:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984799232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239495:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984799232:12345-0@lo:400:kworker.0 Request processed in 28us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789596834.239523:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789596834.239548:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984799744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239576:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984799744:12345-0@lo:400:kworker.0 Request processed in 30us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239582:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789596834.239594:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789596834.239599:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984798848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239626:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984798848:12345-0@lo:400:kworker.0 Request processed in 27us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239631:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789596834.239663:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798720 00000100:00100000:2.0:1789596834.239668:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798720 00000100:00100000:2.0:1789596834.239708:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984798976 00000100:00100000:2.0:1789596834.239712:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984798976 00000100:00100000:2.0:1789596834.239726:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789596834.239733:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984798720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239769:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984798720:12345-0@lo:400:kworker.0 Request processed in 37us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239775:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789596834.239785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789596834.239790:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984798976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.239817:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984798976:12345-0@lo:400:kworker.0 Request processed in 26us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.239822:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00010000:2.0:1789596834.239860:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596834.239869:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789596834.239873:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596834.240276:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984798720:0@lo:400:kworker.0 00010000:00080000:2.0:1789596834.240300:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb6744a80 x1876527984799232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596834.240312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984799232:0@lo:400:kworker.0 00010000:00080000:2.0:1789596834.240325:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb6745c00 x1876527984799744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596834.240334:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984799744:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.240346:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984798592:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.240357:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984799104:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.240369:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984799616:0@lo:400:kworker.0 00000100:00100000:2.0:1789596834.240564:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800128 00000100:00100000:2.0:1789596834.240572:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800128 00000100:00100000:2.0:1789596834.240617:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789596834.240625:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984800128:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596834.241145:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984798464:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.241169:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984798976:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.241184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984799488:0@lo:400:kworker.0 00010000:00080000:1.0:1789596834.241201:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb212d80 x1876527984800000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596834.241212:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984800000:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.241228:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984798848:0@lo:400:kworker.0 00000100:00100000:1.0:1789596834.241241:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984799360:0@lo:400:kworker.0 00010000:00080000:1.0:1789596834.241277:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb6744380 x1876527984799872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596834.241286:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984799872:0@lo:400:kworker.0 00002000:00000024:2.0:1789596834.242598:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596834.242738:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984800128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2109us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.242749:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789596834.242867:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596834.242884:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984800256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596834.242927:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596834.242997:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800256 00000100:00100000:2.0:1789596834.243005:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800256 00000100:00100000:2.0:1789596834.243046:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789596834.243056:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984800256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789596834.243069:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596834.243102:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984800256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596834.243108:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1789596834.243141:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e92d44e00 x1876527984800256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596834.243160:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984800256:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789596834.244071:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e92d43100 x1876527984800128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596834.244110:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984800128:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789596835.264633:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789596835.325412:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789596835.326304:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789596835.776185:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984800384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596835.776298:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596835.779484:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800384 00000100:00100000:3.0:1789596835.779520:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800384 00000100:00100000:3.0:1789596835.779652:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789596835.779697:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984800384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596835.779763:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596835.779888:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984800384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 212us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596835.779895:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789596835.779983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984800384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596835.837145:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596835.837205:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596835.837229:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596835.837254:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596835.837283:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596835.837323:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636480 00000100:00100000:0.0:1789596835.837338:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636480 00000100:00100000:1.0:1789596835.837485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636224 00000100:00100000:1.0:1789596835.837491:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636224 00000100:00100000:1.0:1789596835.837557:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 383 00000100:00100000:1.0:1789596835.837570:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961636224:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596835.837697:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961636224:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 111us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596835.837705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 383 00000100:00100000:0.0:1789596835.838073:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636736 00000100:00100000:0.0:1789596835.838078:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636736 00000100:00100000:0.0:1789596835.838099:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636352 00000100:00100000:0.0:1789596835.838102:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636352 00000100:00100000:0.0:1789596835.838117:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636608 00000100:00100000:0.0:1789596835.838119:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636608 00000100:00100000:0.0:1789596835.838136:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:0.0:1789596835.838143:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961636480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596835.838189:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961636480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596835.838196:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:0.0:1789596835.838211:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 290 00000100:00100000:0.0:1789596835.838217:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961636736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596835.838266:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961636736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596835.838272:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 290 00000100:00100000:0.0:1789596835.838284:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:0.0:1789596835.838290:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961636352:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596835.838315:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961636352:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596835.838321:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:0.0:1789596835.838333:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 292 00000100:00100000:0.0:1789596835.838339:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961636608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596835.838362:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961636608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596835.838368:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 292 00000100:00080000:0.0:1789596835.839128:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596835.839136:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789596836.286480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596837.310403:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596837.821245:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984800512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596837.821352:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596837.821441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800512 00000100:00100000:1.0:1789596837.821451:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800512 00000100:00100000:1.0:1789596837.821522:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789596837.821533:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984800512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596837.821581:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596837.821630:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984800512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596837.821648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789596837.821721:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984800512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596838.335189:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596838.848917:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984800640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596838.849015:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596838.849157:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800640 00000100:00100000:2.0:1789596838.849168:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800640 00000100:00100000:2.0:1789596838.849241:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789596838.849255:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984800640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596838.849311:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789596838.849579:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596838.849808:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984800768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596838.849850:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596838.849891:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800768 00000100:00100000:0.0:1789596838.849896:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800768 00000100:00100000:0.0:1789596838.849931:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789596838.849939:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984800768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596838.849952:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596838.849989:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984800768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596838.850011:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789596838.850037:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596838.850080:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984800768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596838.851136:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984800640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1877us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596838.851147:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789596838.851646:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984800640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789596839.357103:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596839.357370:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984801280:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.357664:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596839.357763:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984801792:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.357793:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596839.357809:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984802304:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.357827:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596839.357852:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789596839.357858:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984801152:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.357884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596839.357901:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984801664:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.357923:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596839.357938:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984802176:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.357957:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596839.357993:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801280 00000100:00100000:3.0:1789596839.358003:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801280 00000100:00100000:3.0:1789596839.358053:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801664 00000100:00100000:3.0:1789596839.358055:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801664 00000100:00100000:3.0:1789596839.358078:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802176 00000100:00100000:3.0:1789596839.358080:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802176 00000100:00100000:3.0:1789596839.358110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789596839.358119:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984801280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.358178:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984801280:12345-0@lo:400:kworker.0 Request processed in 60us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596839.358185:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789596839.358202:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789596839.358208:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984801664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.358233:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984801664:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596839.358239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789596839.358249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789596839.358255:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984802176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.358280:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984802176:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596839.358286:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00080000:3.0:1789596839.358327:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837bad80 x1876527984801664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596839.358343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984801664:0@lo:400:kworker.0 00010000:00080000:3.0:1789596839.358355:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837b9c00 x1876527984802176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596839.358364:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984802176:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.358374:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984801280:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358497:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984800896:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358585:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984801408:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358611:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358627:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984801920:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358646:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358665:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984802432:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358731:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789596839.358737:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984801024:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358756:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358771:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984801536:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358789:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358798:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984802048:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358814:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.358834:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801792 00000100:00100000:2.0:1789596839.358838:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801792 00000100:00100000:2.0:1789596839.358864:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802304 00000100:00100000:2.0:1789596839.358867:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802304 00000100:00100000:2.0:1789596839.358879:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801920 00000100:00100000:2.0:1789596839.358881:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801920 00000100:00100000:2.0:1789596839.358890:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802432 00000100:00100000:2.0:1789596839.358892:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802432 00000100:00100000:2.0:1789596839.358904:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596839.358910:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984801792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.358946:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984801792:12345-0@lo:400:kworker.0 Request processed in 37us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.358952:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596839.358974:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789596839.358980:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984802304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359009:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984802304:12345-0@lo:400:kworker.0 Request processed in 30us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.359015:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789596839.359028:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789596839.359034:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984801920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359063:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984801920:12345-0@lo:400:kworker.0 Request processed in 30us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.359069:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789596839.359080:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789596839.359086:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984802432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359111:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984802432:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.359117:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789596839.359136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801024 00000100:00100000:2.0:1789596839.359140:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801024 00000100:00100000:2.0:1789596839.359154:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801536 00000100:00100000:2.0:1789596839.359156:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801536 00000100:00100000:2.0:1789596839.359168:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802048 00000100:00100000:2.0:1789596839.359170:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802048 00000100:00100000:2.0:1789596839.359183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789596839.359188:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984801024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359215:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984801024:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.359221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789596839.359232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789596839.359245:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984801536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359272:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984801536:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.359278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789596839.359290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789596839.359295:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984802048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359322:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984802048:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.359327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789596839.359359:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984801024:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359368:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984801536:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359377:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984802048:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.359386:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984801920:0@lo:400:kworker.0 00010000:00080000:2.0:1789596839.359396:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837ba300 x1876527984802432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596839.359406:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984802432:0@lo:400:kworker.0 00000100:00100000:1.0:1789596839.359727:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801152 00000100:00100000:1.0:1789596839.359732:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801152 00000100:00100000:1.0:1789596839.359758:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984801408 00000100:00100000:1.0:1789596839.359761:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984801408 00000100:00100000:1.0:1789596839.359775:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789596839.359782:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984801152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596839.359828:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984801152:12345-0@lo:400:kworker.0 Request processed in 47us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596839.359834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789596839.359864:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789596839.359870:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984801408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596839.359899:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984801408:12345-0@lo:400:kworker.0 Request processed in 29us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596839.359905:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789596839.359940:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984801408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596839.359949:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596839.359959:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984802560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596839.359993:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789596839.360147:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596839.360153:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596839.360156:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596839.360168:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802560 00000100:00100000:0.0:1789596839.360172:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802560 00000100:00100000:0.0:1789596839.360214:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789596839.360222:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984802560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596839.360248:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596839.360291:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984802560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596839.360298:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789596839.361277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984800896 00000100:00100000:3.0:1789596839.361286:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984800896 00000100:00100000:2.0:1789596839.361839:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984802688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596839.361907:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596839.361961:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802688 00000100:00100000:2.0:1789596839.361966:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802688 00000100:00100000:2.0:1789596839.362014:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789596839.362023:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984802688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789596839.362048:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596839.362110:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984802688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596839.362118:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1789596839.362166:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e92d47800 x1876527984802688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596839.362186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984802688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596839.362239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984801152:0@lo:400:kworker.0 00000100:00100000:2.0:1789596839.362253:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984801792:0@lo:400:kworker.0 00010000:00080000:2.0:1789596839.362264:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837b9500 x1876527984802304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596839.362273:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984802304:0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.362769:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789596839.362776:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984800896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596839.362829:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984800896:12345-0@lo:400:kworker.0 Request processed in 54us (4279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596839.362835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00080000:1.0:1789596839.363080:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e85f09180 x1876527984802560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596839.363116:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984802560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596839.363130:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984800896:0@lo:400:kworker.0 00010000:00010000:3.0:1789596840.390908:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596840.582831:0:14065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:13:59 (1789596839) 00000100:00100000:2.0:1789596840.895399:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984802816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596840.895503:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596840.897371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802816 00000100:00100000:1.0:1789596840.897384:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802816 00000100:00100000:1.0:1789596840.897433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789596840.897442:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984802816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596840.897493:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596840.897573:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984802816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596840.897580:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789596840.903191:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984802816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596840.954773:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596840.954820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596840.954843:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596840.954872:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596840.954898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596840.954928:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961637120 00000100:00100000:0.0:1789596840.954938:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961637120 00000100:00100000:0.0:1789596840.955006:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961637376 00000100:00100000:0.0:1789596840.955010:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961637376 00000100:00100000:0.0:1789596840.955025:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636992 00000100:00100000:0.0:1789596840.955028:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636992 00000100:00100000:0.0:1789596840.955041:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961637248 00000100:00100000:0.0:1789596840.955057:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961637248 00000100:00100000:0.0:1789596840.955076:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:0.0:1789596840.955085:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961637120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596840.955160:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961637120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 75us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596840.955167:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:0.0:1789596840.955184:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:0.0:1789596840.955191:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961637376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596840.955215:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961637376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596840.955221:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:0.0:1789596840.955245:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:0.0:1789596840.955260:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961636992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596840.955287:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961636992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596840.955292:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:0.0:1789596840.955305:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:0.0:1789596840.955311:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961637248:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596840.955334:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961637248:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596840.955339:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00080000:0.0:1789596840.955358:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596840.955362:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596840.955972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961636864 00000100:00100000:1.0:1789596840.955990:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961636864 00000100:00100000:1.0:1789596840.956035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 385 00000100:00100000:1.0:1789596840.956044:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961636864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596840.956084:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961636864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 41us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596840.956090:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 385 00010000:00010000:3.0:1789596841.404965:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596842.428994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596842.799108:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596842.799276:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961637504 00000100:00100000:2.0:1789596842.799286:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961637504 00000100:00100000:2.0:1789596842.799370:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:2.0:1789596842.799381:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:11093:x1876527961637504:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596842.799401:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596842.799426:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbec1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078c0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.799505:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbec22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.799525:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbec22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.799539:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbec22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596842.799586:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789596842.799590:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596842.799640:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbec22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.799665:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbec1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078c0 expref: 7 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.799720:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbec22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078c0 expref: 6 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.799730:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8200) 00010000:00010000:2.0:1789596842.799733:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596842.799736:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dcc00, rc 0) 00000100:00100000:2.0:1789596842.799803:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:11093:x1876527961637504:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 424us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596842.799819:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00080000:0.0:1789596842.800509:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596842.804252:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596842.804402:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961637632 00000100:00100000:2.0:1789596842.804412:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961637632 00000100:00100000:2.0:1789596842.804526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789596842.804537:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:11094:x1876527961637632:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596842.804558:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596842.804589:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbec29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078c7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804662:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804710:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804724:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804739:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804754:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804817:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd000/0x7b5398e289bbec3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804825:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd000/0x7b5398e289bbec3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804833:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd000/0x7b5398e289bbec3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596842.804869:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789596842.804873:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596842.804893:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd000/0x7b5398e289bbec3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804910:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804917:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804924:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804931:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596842.804936:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804944:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804956:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8200) 00010000:00010000:2.0:1789596842.804959:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596842.804964:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804970:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbec30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804985:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804992:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.804997:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805009:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596842.805012:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805018:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805026:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c7e993a8900) 00010000:00010000:2.0:1789596842.805028:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596842.805031:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805037:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbec37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805068:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbec29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078c7 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805096:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd000/0x7b5398e289bbec3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078c7 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596842.805104:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7e993a8c00) 00010000:00010000:2.0:1789596842.805107:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596842.805109:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd000, rc 0) 00000100:00100000:2.0:1789596842.805183:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11094:x1876527961637632:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 647us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596842.805190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789596842.816407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596842.816508:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961637760 00000100:00100000:1.0:1789596842.816518:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961637760 00000100:00100000:1.0:1789596842.816579:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789596842.816590:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11094:x1876527961637760:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789596842.816704:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11094:x1876527961637760:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596842.816712:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789596842.819066:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596842.819214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638016 00000100:00100000:3.0:1789596842.819224:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638016 00000100:00100000:3.0:1789596842.819288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789596842.819298:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11094:x1876527961638016:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596842.819321:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596842.819456:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819527:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819540:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819551:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819563:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819569:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819597:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819788:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bbec5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819797:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bbec5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.819812:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bbec5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596842.819824:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789596842.820294:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820304:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820311:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820316:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596842.820320:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820556:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820572:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7e993a8c00) 00010000:00010000:3.0:1789596842.820575:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596842.820588:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820592:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820603:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820606:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820610:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820613:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596842.820614:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820618:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820622:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7e82a39c00) 00010000:00010000:3.0:1789596842.820623:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596842.820625:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec53 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820956:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ce expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820985:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bbec5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ce expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596842.820993:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:3.0:1789596842.820995:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596842.820997:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da000, rc 0) 00000100:00100000:3.0:1789596842.821323:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11094:x1876527961638016:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2024us (2263us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789596842.821400:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1789596842.836224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596842.836302:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638144 00000100:00100000:1.0:1789596842.836312:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638144 00000100:00100000:1.0:1789596842.836381:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:1.0:1789596842.836390:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11094:x1876527961638144:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789596842.836560:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11094:x1876527961638144:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 169us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596842.836567:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789596842.840996:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596842.841136:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638272 00000100:00100000:2.0:1789596842.841146:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638272 00000100:00100000:2.0:1789596842.841255:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789596842.841266:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:11094:x1876527961638272:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789596842.841982:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 672us 00000100:00080000:0.0:1789596842.846657:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596842.865320:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:11094:x1876527961638272:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 24044us (24323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596842.865333:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789596842.941710:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984802944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596842.941781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596842.941943:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984802944 00000100:00100000:1.0:1789596842.941952:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984802944 00000100:00100000:1.0:1789596842.942008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789596842.942018:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984802944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596842.942053:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789596842.942110:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984802944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596842.942117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789596842.942202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984802944:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596843.453730:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789596843.517422:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789596843.518433:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596843.964819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984803072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596843.964898:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596843.964991:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803072 00000100:00100000:0.0:1789596843.965000:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803072 00000100:00100000:0.0:1789596843.965054:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789596843.965064:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984803072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596843.965094:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596843.965137:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984803072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596843.965144:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789596843.965164:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596843.965214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984803072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596843.970446:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984803200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596843.970535:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596843.970648:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803200 00000100:00100000:3.0:1789596843.970658:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803200 00000100:00100000:3.0:1789596843.970758:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789596843.970767:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984803200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596843.970791:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596843.970843:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984803200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596843.970849:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1789596843.970869:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596843.970907:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984803200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596844.476828:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596844.476852:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984803328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596844.476944:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596844.477039:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803328 00000100:00100000:1.0:1789596844.477048:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803328 00000100:00100000:1.0:1789596844.477116:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789596844.477128:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984803328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596844.477157:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789596844.477205:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984803328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596844.477212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789596844.477259:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596844.477322:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984803456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596844.477358:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789596844.477440:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e85f0b480 x1876527984803328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596844.477460:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984803328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596844.477564:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803456 00000100:00100000:3.0:1789596844.477569:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803456 00000100:00100000:3.0:1789596844.477620:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789596844.477627:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984803456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596844.477638:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596844.477674:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984803456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596844.477717:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:3.0:1789596844.477891:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596844.477899:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984803840:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.478099:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.478121:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984804352:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.478145:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.478161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984804864:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.478180:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.478198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789596844.478203:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984803712:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.478225:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.478242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984804224:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.478262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.478278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984804736:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.478297:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.478325:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803840 00000100:00100000:3.0:1789596844.478329:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803840 00000100:00100000:3.0:1789596844.478358:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789596844.478365:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984803840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.478580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804352 00000100:00100000:0.0:1789596844.478585:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804352 00000100:00100000:0.0:1789596844.478609:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804864 00000100:00100000:0.0:1789596844.478612:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804864 00000100:00100000:0.0:1789596844.478624:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803712 00000100:00100000:0.0:1789596844.478626:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803712 00000100:00100000:0.0:1789596844.478635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804224 00000100:00100000:0.0:1789596844.478637:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804224 00000100:00100000:0.0:1789596844.478648:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804736 00000100:00100000:0.0:1789596844.478650:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804736 00000100:00100000:0.0:1789596844.478663:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789596844.478670:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984804352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.478742:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984804352:12345-0@lo:400:kworker.0 Request processed in 72us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.478748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789596844.478761:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789596844.478768:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984804864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.478794:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984804864:12345-0@lo:400:kworker.0 Request processed in 27us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.478799:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789596844.478809:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789596844.478815:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984803712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.478840:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984803712:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.479067:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789596844.479082:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789596844.479088:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984804224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596844.486742:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984803712:0@lo:400:kworker.0 00000100:00080000:1.0:1789596844.487605:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596844.487614:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789596844.487618:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596844.488069:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984804224:12345-0@lo:400:kworker.0 Request processed in 8974us (9799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.488084:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789596844.488124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789596844.488137:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984804736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.488189:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984804736:12345-0@lo:400:kworker.0 Request processed in 57us (9891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.488196:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789596844.488622:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984803840:0@lo:400:kworker.0 00010000:00080000:1.0:1789596844.488641:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869bdc00 x1876527984804352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596844.488653:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984804352:0@lo:400:kworker.0 00010000:00080000:1.0:1789596844.488668:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869bf100 x1876527984804864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596844.488675:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984804864:0@lo:400:kworker.0 00000100:00100000:1.0:1789596844.488723:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984804224:0@lo:400:kworker.0 00000100:00100000:1.0:1789596844.488732:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984804736:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.488816:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984803840:12345-0@lo:400:kworker.0 Request processed in 10450us (10715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596844.488834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789596844.489043:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984803584:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489087:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.489180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984804096:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489205:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.489231:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984804608:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.489276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789596844.489283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984803968:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489304:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.489318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984804480:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596844.489365:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804608 00000100:00100000:3.0:1789596844.489372:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804608 00000100:00100000:3.0:1789596844.489429:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804480 00000100:00100000:3.0:1789596844.489442:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804480 00000100:00100000:3.0:1789596844.489464:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789596844.489472:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984804608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489512:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984804608:12345-0@lo:400:kworker.0 Request processed in 41us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596844.489518:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789596844.489531:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596844.489536:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984804480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489559:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984804480:12345-0@lo:400:kworker.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596844.489572:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789596844.489617:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e92d47800 x1876527984803456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596844.489635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984803456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596844.489656:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984804480:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.489664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984804608:0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.489944:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984804096 00000100:00100000:0.0:1789596844.489948:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984804096 00000100:00100000:0.0:1789596844.489987:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789596844.489993:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984804096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.490031:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984804096:12345-0@lo:400:kworker.0 Request processed in 39us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.490037:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789596844.490052:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803968 00000100:00100000:0.0:1789596844.490055:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803968 00000100:00100000:0.0:1789596844.490074:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789596844.490080:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984803968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596844.490107:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984803968:12345-0@lo:400:kworker.0 Request processed in 27us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596844.490113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789596844.490244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984803968:0@lo:400:kworker.0 00000100:00100000:3.0:1789596844.490254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984804096:0@lo:400:kworker.0 00000100:00100000:1.0:1789596844.490306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984803584 00000100:00100000:1.0:1789596844.490310:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984803584 00000100:00100000:1.0:1789596844.490343:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789596844.490348:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3647:x1876527984803584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596844.490709:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3647:x1876527984803584:12345-0@lo:400:kworker.0 Request processed in 359us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596844.490715:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789596844.490783:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984803584:0@lo:400:kworker.0 00000100:00100000:3.0:1789596845.214307:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.214345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638400 00000100:00100000:3.0:1789596845.214355:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638400 00000100:00100000:3.0:1789596845.214419:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1789596845.214444:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11137:x1876527961638400:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596845.214465:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596845.214485:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078d5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214546:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214591:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214606:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214613:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214636:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214705:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214713:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214720:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214725:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596845.214730:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214738:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214751:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8200) 00010000:00010000:3.0:1789596845.214755:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.214760:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214773:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214787:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214794:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214800:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214805:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596845.214808:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214815:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214822:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c7d82471500) 00010000:00010000:3.0:1789596845.214824:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.214827:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214833:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214866:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078d5 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214888:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8200) 00010000:00010000:3.0:1789596845.214890:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.214895:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078d5 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.214905:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789596845.214964:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11137:x1876527961638400:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 524us (667us total) trans 0 rc 301/301 00000100:00100000:3.0:1789596845.214972:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00080000:3.0:1789596845.214996:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596845.233545:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.233627:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638656 00000100:00100000:3.0:1789596845.233640:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638656 00000100:00100000:3.0:1789596845.233794:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789596845.233806:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11137:x1876527961638656:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:3.0:1789596845.233865:0:11184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596845.233893:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbec22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078c0 expref: 9 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.233914:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e993a8200) 00010000:00010000:3.0:1789596845.233927:0:11184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596845.234465:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.234481:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.234493:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.234517:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.234524:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.234532:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.235888:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.235907:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.235921:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596845.235948:0:11184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011abcd87 reply state 000000004334b31a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.235969:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.235976:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596845.235979:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596845.235983:0:11184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789596845.235990:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789596845.235999:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236005:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236019:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236025:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596845.236030:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236038:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236048:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d82471500) 00010000:00010000:3.0:1789596845.236050:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.236054:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236060:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbec7d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596845.236074:0:11184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011abcd87 reply state 000000004334b31a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236083:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.236090:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c7d82471b00) 00010000:00010000:3.0:1789596845.236092:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596845.236094:0:11184:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789596845.236219:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+10:11137:x1876527961638656:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 2412us (2680us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789596845.236236:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1789596845.364392:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596845.366672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638784 00000100:00100000:1.0:1789596845.366704:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638784 00000100:00100000:1.0:1789596845.366767:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1789596845.366778:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+10:11145:x1876527961638784:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:1.0:1789596845.366809:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596845.366833:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6200/0x7b5398e289bbec92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.366918:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6800/0x7b5398e289bbec99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.366932:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6800/0x7b5398e289bbec99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.368124:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6800/0x7b5398e289bbec99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596845.368191:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789596845.368269:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596845.368324:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6800/0x7b5398e289bbec99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.368361:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6200/0x7b5398e289bbec92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078dc expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.368385:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6800/0x7b5398e289bbec99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078dc expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.368394:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:1.0:1789596845.368397:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596845.368400:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb64c6800, rc 0) 00000100:00100000:1.0:1789596845.368494:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+11:11145:x1876527961638784:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 1716us (4112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596845.368502:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789596845.494473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.494833:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961638912 00000100:00100000:3.0:1789596845.494844:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961638912 00000100:00100000:3.0:1789596845.494909:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1789596845.494918:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+11:11151:x1876527961638912:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596845.494938:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596845.494966:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbeca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078e3 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495025:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495039:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495051:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495062:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495068:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495074:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495149:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbecb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495156:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495180:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596845.495218:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789596845.495222:0:8967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596845.495263:0:8967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495276:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495283:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495290:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495296:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596845.495300:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495307:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495319:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:3.0:1789596845.495323:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.495327:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495333:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbeca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495358:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495364:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495370:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495375:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596845.495378:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495384:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495393:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c7d82471b00) 00010000:00010000:3.0:1789596845.495395:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.495398:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495403:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495441:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbeca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078e3 expref: 13 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495455:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbecb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078e3 expref: 12 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.495474:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596845.495476:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789596845.495479:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db600, rc 0) 00000100:00100000:3.0:1789596845.495549:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+12:11151:x1876527961638912:12345-192.168.202.16@tcp:101:bash.0 Request processed in 632us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596845.495557:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00010000:00010000:2.0:1789596845.500914:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596845.505876:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.506157:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961639168 00000100:00100000:3.0:1789596845.506172:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961639168 00000100:00100000:3.0:1789596845.506240:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1789596845.506251:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+12:11151:x1876527961639168:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596845.506274:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596845.506295:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbecbc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078ea expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.506411:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.506456:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.506468:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.506502:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.506509:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.506537:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596845.506923:0:11184:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789596845.510508:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510532:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510545:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510585:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510592:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510598:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510604:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596845.510610:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510618:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510631:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596845.510635:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596845.510660:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510668:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbecc3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596845.510707:0:11184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a90df08b reply state 00000000b1bed640 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510720:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510726:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d82471500) 00010000:00010000:3.0:1789596845.510729:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596845.510733:0:11184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789596845.510778:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbecbc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 15 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510795:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 14 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.510802:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:3.0:1789596845.510805:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596845.510807:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbe00, rc 0) 00000100:00100000:3.0:1789596845.510903:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11151:x1876527961639168:12345-192.168.202.16@tcp:101:bash.0 Request processed in 4651us (5037us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789596845.510912:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1789596845.519803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596845.520114:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961639296 00000100:00100000:2.0:1789596845.520124:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961639296 00000100:00100000:2.0:1789596845.520188:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:2.0:1789596845.520196:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1876527961639296:12345-192.168.202.16@tcp:8:bash.0 00010000:00080000:2.0:1789596845.520232:0:8437:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:2.0:1789596845.520776:0:8437:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbecdf 00002000:00100000:2.0:1789596845.520796:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2396ff16-3863-41e8-8748-2ac67b0298b6/ffff9c7e853fe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789596845.520812:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789596845.520910:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789596845.521062:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c7e853fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596845.521147:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961639296:12345-192.168.202.16@tcp:8:bash.0 Request processed in 948us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596845.521156:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:3.0:1789596845.524989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596845.525187:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961639424 00000100:00100000:0.0:1789596845.525199:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961639424 00000100:00100000:0.0:1789596845.525280:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1789596845.525292:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961639424:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789596845.525309:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596845.525334:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078f1 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596845.525361:0:9893:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789596845.525382:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1789596845.525387:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596845.525397:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 7 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.525420:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 7 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.525444:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743200, rc 0) 00000100:00100000:0.0:1789596845.525501:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:0:x1876527961639424:12345-192.168.202.16@tcp:101:bash.0 Request processed in 212us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596845.525507:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00080000:3.0:1789596845.525732:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596845.528787:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596845.529530:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961639552 00000100:00100000:2.0:1789596845.529545:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961639552 00000100:00100000:2.0:1789596845.529620:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789596845.529631:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11151:x1876527961639552:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596845.529665:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596845.529720:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078f8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.529755:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 8 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.529764:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596845.529768:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596845.529772:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.529808:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 8 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.529822:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 8 pid: 9893 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596845.529838:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876527984804992:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596845.530171:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb03999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596845.553064:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596845.553471:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961639680 00000100:00100000:1.0:1789596845.553483:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961639680 00010000:00010000:1.0:1789596845.553526:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 9 pid: 9893 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596845.553570:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789596845.553581:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e91849c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961639680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596845.553596:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596845.553620:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 9 pid: 9893 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.553636:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 9 pid: 9893 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.553666:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596845.553671:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596845.553720:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.553732:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.553774:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596845.553788:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876527984805120:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789596845.553894:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679f9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789596845.554177:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbece6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f1 expref: 9 pid: 9893 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596845.554204:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876527984804992:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596845.554231:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.554250:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd600, rc 0) 00000100:00100000:2.0:1789596845.554286:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:11151:x1876527961639552:12345-192.168.202.16@tcp:101:bash.0 Request processed in 24657us (25509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596845.554294:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789596845.560963:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876527984805120:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789596845.560993:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596845.561068:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e91849c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961639680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7488us (8015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596845.561080:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789596845.562846:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.569360:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961639936 00000100:00100000:3.0:1789596845.569382:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961639936 00000100:00100000:3.0:1789596845.571401:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789596845.571416:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11151:x1876527961639936:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:3.0:1789596845.572871:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11151:x1876527961639936:12345-192.168.202.16@tcp:35:bash.0 Request processed in 1449us (10027us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789596845.572882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000040:00080000:1.0:1789596845.573797:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789596845.574370:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596845.713241:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596845.713644:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961640192 00000100:00100000:1.0:1789596845.713656:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961640192 00000100:00100000:1.0:1789596845.713758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789596845.713769:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11161:x1876527961640192:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596845.713796:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596845.713818:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbecf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e078ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596845.713961:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789596845.714108:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbecf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ff expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.714125:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:1.0:1789596845.714128:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596845.714143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbecf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ff expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.714159:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1e00, rc 0) 00000100:00100000:1.0:1789596845.714962:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11161:x1876527961640192:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1186us (1728us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789596845.714994:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:0.0:1789596845.728810:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596845.728974:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961640448 00000100:00100000:2.0:1789596845.728985:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961640448 00000100:00100000:2.0:1789596845.729097:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789596845.729109:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11161:x1876527961640448:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596845.731910:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+18:11161:x1876527961640448:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 2793us (3102us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789596845.731922:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789596845.871525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596845.871649:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961640576 00000100:00100000:1.0:1789596845.871660:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961640576 00000100:00100000:1.0:1789596845.871775:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1789596845.871786:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:11167:x1876527961640576:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596845.871933:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596845.871976:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbed02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07906 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.872063:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbed09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.872092:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbed09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.872106:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbed09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596845.872152:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789596845.872156:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596845.872174:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbed09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.872202:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbed02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07906 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.872233:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbed09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07906 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.872540:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596845.872544:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596845.872547:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1000, rc 0) 00000100:00100000:1.0:1789596845.872613:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11167:x1876527961640576:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 828us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596845.872620:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:0.0:1789596845.882506:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.882834:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961640832 00000100:00100000:3.0:1789596845.882846:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961640832 00000100:00100000:3.0:1789596845.882917:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:3.0:1789596845.882930:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11167:x1876527961640832:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596845.882965:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596845.882989:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0790d expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.883133:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.883149:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.883163:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596845.883174:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789596845.883470:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0790d expref: 22 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.883489:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0790d expref: 21 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.883507:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:3.0:1789596845.883511:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596845.883516:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789596845.883601:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11167:x1876527961640832:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 673us (1107us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789596845.883609:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789596845.889546:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596845.889631:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641088 00000100:00100000:1.0:1789596845.889643:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641088 00000100:00100000:1.0:1789596845.889741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1789596845.889753:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11167:x1876527961641088:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596845.889782:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596845.889802:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbed25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07914 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.889953:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbed2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.889970:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbed2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.889982:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbed2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596845.889997:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789596845.890099:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbed25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07914 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.890160:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbed2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07914 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596845.890169:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:1.0:1789596845.890172:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789596845.890177:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1600, rc 0) 00000100:00100000:1.0:1789596845.890231:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11167:x1876527961641088:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 480us (695us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789596845.890426:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1789596845.903037:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596845.903092:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596845.903265:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641216 00000100:00100000:0.0:1789596845.903277:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641216 00000100:00100000:0.0:1789596845.903342:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789596845.903352:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961641216:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:0.0:1789596845.903403:0:9893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.903436:0:9893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.903445:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596845.903450:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596845.903455:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.903492:0:9893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.903507:0:9893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 7 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596845.903521:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9893:1876527984805248:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596845.903621:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596845.904081:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641344 00000100:00100000:2.0:1789596845.904088:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641344 00000100:00100000:2.0:1789596845.904137:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789596845.904146:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:2409:x1876527961641344:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596845.904157:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596845.904179:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0790d expref: 23 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.904198:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:2.0:1789596845.904202:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596845.904248:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2409:x1876527961641344:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 103us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596845.904276:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1789596845.909296:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9893:1876527984805248:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596845.909329:0:9893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596845.914879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596845.918194:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641472 00000100:00100000:2.0:1789596845.918211:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641472 00002000:00100000:2.0:1789596845.918508:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9c7e867e0380 x1876527961641472/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:726/0 lens 504/0 e 0 to 0 dl 1789596856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596845.918519:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e867e0380 with x1876527961641472 ext(0->12) 00010000:00010000:2.0:1789596845.918530:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 8 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.918548:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 8 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596845.918556:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7e867e0380 00000100:00100000:2.0:1789596845.918595:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789596845.918606:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961641472:12345-192.168.202.16@tcp:4:lfs.0 00000001:00100000:1.0:1789596845.925414:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000100:00100000:2.0:1789596845.927550:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961641472:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 8631us (12430us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789596845.927565:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:2.0:1789596845.927579:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9c7e867e0380 x1876527961641472/t4294967300(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:726/0 lens 504/448 e 0 to 0 dl 1789596856 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596845.927591:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e867e0380 with x1876527961641472 ext(0->12) 00010000:00010000:2.0:1789596845.927602:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.927640:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596845.927650:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7e867e0380 00000100:00100000:1.0:1789596845.941004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.941148:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641600 00000100:00100000:3.0:1789596845.941157:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641600 00010000:00010000:3.0:1789596845.941208:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596845.941245:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789596845.941254:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2407:x1876527961641600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596845.941269:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789596845.941288:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789596845.941291:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789596846 00002000:00010000:3.0:1789596845.941293:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789596846 00002000:00010000:3.0:1789596845.941295:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789596846 00002000:00010000:3.0:1789596845.941297:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789596845.941303:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.941317:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.941359:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309bb79d/0x7b5398e289bbeced lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078f8 expref: 9 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.941376:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596845.941380:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596845.941386:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.941395:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.941435:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596845.941493:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2407:x1876527961641600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 239us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596845.941500:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00010000:00010000:0.0:1789596845.941616:0:9893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941627:0:9893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941648:0:9893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941656:0:9893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941664:0:9893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941671:0:9893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596845.941717:0:9893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941727:0:9893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941739:0:9893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.941759:0:9893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebfc12a7/0x7b5398e289bbed3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596845.941805:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961641216:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 38455us (38781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596845.941812:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789596845.945236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596845.948883:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641856 00000100:00100000:0.0:1789596845.948899:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641856 00000100:00100000:0.0:1789596845.948968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789596845.948979:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11167:x1876527961641856:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:0.0:1789596845.949048:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbed2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07914 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596845.949307:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789596845.949352:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789596845.949844:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789596845.949886:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.949903:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 26 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.949913:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.949951:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 26 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596845.949982:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 26 pid: 11184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596845.950000:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876527984805376:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596845.950104:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596845.955335:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596845.955468:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876527984805376:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596845.955496:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596845.955862:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961641984 00000100:00100000:2.0:1789596845.955871:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961641984 00010000:00010000:2.0:1789596845.955907:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 27 pid: 11184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596845.955949:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789596845.955958:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:2408:x1876527961641984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596845.955974:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596845.955981:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 27 pid: 11184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.955994:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 27 pid: 11184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.956016:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbecd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ea expref: 27 pid: 11184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.956032:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:2.0:1789596845.956038:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.956047:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.956069:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.956099:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596845.956168:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+26:2408:x1876527961641984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 210us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596845.956175:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00010000:00010000:3.0:1789596845.956211:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596845.956219:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596845.956330:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1789596845.956465:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1789596845.956563:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984805504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789596845.956613:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596845.956650:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d8364cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596845.956719:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984805504 00000100:00100000:0.0:1789596845.956724:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984805504 00000100:00100000:0.0:1789596845.956758:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789596845.956765:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876527984805504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789596845.956855:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876527984805504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596845.956861:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789596845.957151:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984805504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789596845.957589:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789596845.957650:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984805632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789596845.957729:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596845.957747:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596845.957778:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984805632 00000100:00100000:0.0:1789596845.957785:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984805632 00000100:00100000:0.0:1789596845.957814:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789596845.957822:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876527984805632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789596845.957958:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1876527984805632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (228us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789596845.957965:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789596845.958359:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984805632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789596845.958409:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789596845.958455:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.958465:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.958473:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.958478:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596845.958483:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.958490:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.958519:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:2.0:1789596845.958522:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789596845.958526:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.958533:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbed41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596845.958636:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789596845.958787:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789596845.958798:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420777119156ns, next at 421777117056ns, rc = 0 00000001:00080000:2.0:1789596845.958804:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789596845.958827:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d82471700) 00010000:00010000:2.0:1789596845.958830:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789596845.958837:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbed2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07914 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596845.958948:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11167:x1876527961641856:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 9971us (13722us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789596845.958957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000020:00080000:2.0:1789596845.958961:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789596845.971744:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596845.971846:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961642112 00000100:00100000:2.0:1789596845.971858:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961642112 00000100:00100000:2.0:1789596845.971928:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789596845.971940:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11167:x1876527961642112:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596845.971972:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596845.971998:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbed48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0791b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.972087:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbed48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0791b expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.972104:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbed48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0791b expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596845.972126:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596845.972130:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596845.972146:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd600, rc 0) 00000100:00100000:2.0:1789596845.972214:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11167:x1876527961642112:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 275us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596845.972221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:1.0:1789596845.976953:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596845.977007:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961642368 00000100:00100000:2.0:1789596845.977015:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961642368 00000100:00100000:2.0:1789596845.977067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789596845.977074:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11167:x1876527961642368:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596845.977304:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+31:11167:x1876527961642368:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 229us (368us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789596845.977312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789596846.012918:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596846.012942:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984805760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596846.013006:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596846.013124:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984805760 00000100:00100000:3.0:1789596846.013140:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984805760 00000100:00100000:3.0:1789596846.013185:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789596846.013193:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984805760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596846.013224:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596846.013272:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984805760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596846.013278:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789596846.014984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984805760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596846.073258:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596846.073314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596846.073342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961642496 00000100:00100000:0.0:1789596846.073355:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961642496 00000100:00100000:3.0:1789596846.073360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596846.073408:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596846.073451:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 387 00000100:00100000:3.0:1789596846.073452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961642752 00000100:00100000:3.0:1789596846.073457:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961642752 00000100:00100000:0.0:1789596846.073467:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961642496:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596846.073504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961642624 00000100:00100000:3.0:1789596846.073508:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961642624 00000100:00100000:3.0:1789596846.073537:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961642880 00000100:00100000:3.0:1789596846.073540:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961642880 00000100:00100000:3.0:1789596846.073559:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 309 00000100:00100000:3.0:1789596846.073571:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961642752:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596846.073571:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961642496:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 105us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596846.073586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 387 00000100:00100000:3.0:1789596846.073615:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961642752:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596846.073623:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 309 00000100:00100000:3.0:1789596846.073639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 310 00000100:00100000:3.0:1789596846.073654:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961642624:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596846.073721:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961642624:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 68us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596846.073727:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 310 00000100:00100000:3.0:1789596846.073741:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 311 00000100:00100000:3.0:1789596846.073748:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961642880:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596846.073777:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961642880:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596846.073784:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 311 00000100:00080000:0.0:1789596846.073872:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596846.073877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596846.206671:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596846.207348:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961643136 00000100:00100000:0.0:1789596846.207361:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961643136 00000100:00100000:0.0:1789596846.207439:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789596846.207452:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+31:11177:x1876527961643136:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596846.207482:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596846.207505:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbed4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07922 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596846.207637:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789596846.207780:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbed4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07922 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.207795:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:0.0:1789596846.207799:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596846.207805:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbed4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07922 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.207821:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742200, rc 0) 00000100:00100000:0.0:1789596846.207897:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11177:x1876527961643136:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 449us (1241us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1789596846.207905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789596846.223970:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596846.226547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961643264 00000100:00100000:2.0:1789596846.226565:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961643264 00000100:00100000:2.0:1789596846.226644:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:2.0:1789596846.226655:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11177:x1876527961643264:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1789596846.226787:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226836:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226851:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226865:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226873:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226880:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226963:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226971:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.226978:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596846.227032:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227046:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227053:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227071:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227079:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596846.227083:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227093:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227106:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596846.227110:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596846.227115:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227122:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbed5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227150:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227157:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227164:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227169:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596846.227172:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227189:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227199:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d82471500) 00010000:00010000:2.0:1789596846.227201:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596846.227205:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227211:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbed64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227222:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227229:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227234:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227240:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dcc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596846.227242:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227248:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227254:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596846.227257:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596846.227259:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596846.227276:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbed6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596846.227375:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11177:x1876527961643264:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 719us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596846.227384:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789596846.230042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596846.230121:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961643520 00000100:00100000:2.0:1789596846.230142:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961643520 00000100:00100000:2.0:1789596846.230210:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789596846.230222:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11177:x1876527961643520:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596846.230477:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+33:11177:x1876527961643520:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 257us (444us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789596846.230484:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789596846.319014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596846.319087:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961643776 00000100:00100000:3.0:1789596846.319100:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961643776 00000100:00100000:3.0:1789596846.319335:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1789596846.319348:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+33:11180:x1876527961643776:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596846.319379:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596846.319405:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbed72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07929 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.319829:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.319848:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.319861:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.319895:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.319917:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.319925:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320122:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320226:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320237:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596846.320246:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789596846.320337:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320344:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320351:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320357:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596846.320361:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320379:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320393:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596846.320396:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596846.320401:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320408:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbed79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320816:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320826:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320833:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320838:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbe00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596846.320842:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320849:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320858:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d82471500) 00010000:00010000:3.0:1789596846.320861:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596846.320864:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320881:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbed80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.320932:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbed72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 36 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.321068:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 35 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.321077:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596846.321079:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596846.321083:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789596846.321322:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11180:x1876527961643776:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1976us (2317us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789596846.321331:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1789596846.324925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596846.325185:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961643904 00000100:00100000:1.0:1789596846.325198:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961643904 00000100:00100000:1.0:1789596846.325426:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789596846.325438:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11180:x1876527961643904:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1789596846.325513:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325549:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325563:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325600:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325608:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325616:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325622:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596846.325627:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325635:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325647:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:1.0:1789596846.325651:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596846.325656:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.325664:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbed95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596846.325779:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11180:x1876527961643904:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 342us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596846.325794:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789596846.334315:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596846.334479:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961644160 00000100:00100000:2.0:1789596846.334492:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961644160 00000100:00100000:2.0:1789596846.334559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1789596846.334571:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11180:x1876527961644160:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596846.334948:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+36:11180:x1876527961644160:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 379us (642us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789596846.334956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00010000:00010000:3.0:1789596846.525051:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596846.794523:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596846.794634:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961644416 00000100:00100000:3.0:1789596846.794645:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961644416 00000100:00100000:3.0:1789596846.794735:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789596846.794747:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+36:11211:x1876527961644416:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:3.0:1789596846.794773:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596846.794794:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbed9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.794900:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbeda3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.794926:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.794952:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596846.794965:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789596846.795108:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbed9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07930 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.795128:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbeda3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07930 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.795136:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596846.795139:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596846.795143:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbe00, rc 0) 00000100:00100000:3.0:1789596846.795205:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11211:x1876527961644416:12345-192.168.202.16@tcp:101:cat.0 Request processed in 460us (692us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789596846.795223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789596846.806955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596846.807021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596846.807236:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961644800 00000100:00100000:2.0:1789596846.807254:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961644800 00000100:00100000:2.0:1789596846.807347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789596846.807359:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11211:x1876527961644800:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789596846.807624:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:11211:x1876527961644800:12345-192.168.202.16@tcp:35:cat.0 Request processed in 265us (600us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789596846.807647:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1789596846.808447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961644544 00000100:00100000:0.0:1789596846.808457:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961644544 00000100:00100000:0.0:1789596846.808515:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789596846.808524:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+39:2409:x1876527961644544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596846.808537:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596846.808561:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbeda3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07930 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.808581:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:0.0:1789596846.808587:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596846.808633:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+38:2409:x1876527961644544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 110us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596846.808640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789596846.902472:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596846.902621:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961645056 00000100:00100000:1.0:1789596846.902635:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961645056 00000100:00100000:1.0:1789596846.902763:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789596846.902779:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11217:x1876527961645056:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1789596846.902818:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596846.902823:0:11184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789596846.902860:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbed09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07906 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.902884:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596846.902891:0:11184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596846.902907:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbedb1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07937 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.903051:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.903068:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 38 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.903077:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.903117:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 38 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.903156:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 38 pid: 11184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596846.903174:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984805888:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596846.903298:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596846.911263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596846.911386:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961645184 00000100:00100000:0.0:1789596846.911398:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961645184 00010000:00010000:0.0:1789596846.911461:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 39 pid: 11184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596846.911506:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789596846.911516:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:2408:x1876527961645184:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596846.911545:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596846.911553:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 39 pid: 11184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.911568:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 39 pid: 11184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.911620:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:0.0:1789596846.911627:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.911639:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.911649:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596846.911750:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596846.911826:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:2408:x1876527961645184:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 310us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596846.911834:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00010000:00010000:1.0:1789596846.912787:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbed87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07929 expref: 38 pid: 11184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596846.912816:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984805888:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596846.912847:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.912859:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.912867:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596846.912893:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789596846.913082:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbedb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 39 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.913100:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 38 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.913110:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:1.0:1789596846.913125:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596846.913128:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0c00, rc 0) 00000100:00100000:1.0:1789596846.913254:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11217:x1876527961645056:12345-192.168.202.16@tcp:101:dd.0 Request processed in 10479us (10804us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789596846.913271:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789596846.922289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596846.923051:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961645312 00000100:00100000:1.0:1789596846.923069:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961645312 00000100:00100000:1.0:1789596846.923245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:1.0:1789596846.923258:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11217:x1876527961645312:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1789596846.923290:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596846.923320:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbedc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0793e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.923365:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.923382:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.923396:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.923583:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbedc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.923613:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596846.923622:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:1.0:1789596846.923633:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596846.923639:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1000, rc 0) 00000100:00100000:1.0:1789596846.924146:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+39:11217:x1876527961645312:12345-192.168.202.16@tcp:101:dd.0 Request processed in 888us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596846.924156:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789596846.935924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596846.936156:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961645568 00000100:00100000:3.0:1789596846.936172:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961645568 00000100:00100000:3.0:1789596846.936256:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:3.0:1789596846.936268:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+39:11217:x1876527961645568:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:3.0:1789596846.936615:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.936656:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.936672:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596846.937197:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789596846.937230:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c15ef015 reply state 000000008a9d8ee3 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.937247:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596846.937255:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596846.937259:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596846.937264:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596846.937472:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+42:11217:x1876527961645568:12345-192.168.202.16@tcp:36:dd.0 Request processed in 1203us (1563us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789596846.937482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000020:00080000:3.0:1789596846.937490:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789596847.323322:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596847.323547:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961645696 00000100:00100000:1.0:1789596847.323568:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961645696 00000100:00100000:1.0:1789596847.323763:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1789596847.323779:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+42:11231:x1876527961645696:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:1.0:1789596847.323830:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596847.323861:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbeddb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07945 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.323953:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.323970:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.323986:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.323998:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324005:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324012:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324168:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324183:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 43 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324193:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324240:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 43 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.324258:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 43 pid: 11184 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596847.324275:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984806016:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596847.324437:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679f780 going to sleep for 11 seconds 00000100:00080000:0.0:1789596847.324812:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596847.328914:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596847.331252:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984806016:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596847.331290:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596847.335921:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961645952 00000100:00100000:3.0:1789596847.336521:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961645952 00000100:00100000:3.0:1789596847.336725:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789596847.336736:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+44:6177:x1876527961645952:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789596847.337104:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+45:6177:x1876527961645952:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 368us (8201us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789596847.337112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1789596847.346440:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596847.346590:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961646080 00000100:00100000:0.0:1789596847.346601:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961646080 00010000:00010000:0.0:1789596847.346644:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 45 pid: 11184 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596847.346724:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789596847.346735:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+45:2406:x1876527961646080:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596847.346751:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596847.346758:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 45 pid: 11184 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.346794:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 45 pid: 11184 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.346816:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbedb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07937 expref: 45 pid: 11184 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.346834:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:0.0:1789596847.346839:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.346849:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.346858:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.346892:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596847.347153:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+44:2406:x1876527961646080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 418us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596847.347160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00010000:00010000:3.0:1789596847.347403:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347438:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596847.347504:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789596847.347509:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596847.347553:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347567:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347577:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347584:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347591:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347597:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596847.347601:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347609:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347619:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596847.347622:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596847.347625:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347642:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbede2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347863:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347870:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347876:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347880:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596847.347883:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347889:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347897:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d82471500) 00010000:00010000:3.0:1789596847.347900:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596847.347903:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.347909:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbede9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.348329:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbeddb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07945 expref: 44 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.348360:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07945 expref: 43 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.348367:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596847.348370:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596847.348372:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0e00, rc 0) 00000100:00100000:3.0:1789596847.348434:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+43:11231:x1876527961645696:12345-192.168.202.16@tcp:101:stat.0 Request processed in 24652us (25116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596847.348580:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789596847.462998:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596847.463161:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961646336 00000100:00100000:1.0:1789596847.463172:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961646336 00000100:00100000:1.0:1789596847.463235:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1789596847.463247:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+43:11237:x1876527961646336:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:1.0:1789596847.463341:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596847.463377:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbedf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07945 expref: 43 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.463400:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:1.0:1789596847.463417:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596847.464088:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.464109:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.464121:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596847.464176:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789596847.464200:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002447344f reply state 00000000f80c66f2 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.464214:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.464221:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:1.0:1789596847.464224:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789596847.464228:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789596847.464375:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+45:11237:x1876527961646336:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 1128us (1384us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789596847.464383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000020:00080000:1.0:1789596847.464390:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789596847.548929:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596847.643997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596847.645032:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961646464 00000100:00100000:3.0:1789596847.645045:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961646464 00000100:00100000:3.0:1789596847.645127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:3.0:1789596847.645138:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+45:11251:x1876527961646464:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:3.0:1789596847.645372:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596847.645396:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbedfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0794c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.645485:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.645500:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.645515:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.645552:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.645560:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.645568:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646440:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646455:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646464:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596847.646517:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789596847.646522:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596847.646546:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646559:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646567:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646574:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646595:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646602:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596847.646606:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646614:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646639:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596847.646642:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596847.646647:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646654:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbee05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646669:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646715:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646722:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646728:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbe00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596847.646731:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646747:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646756:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d82471500) 00010000:00010000:3.0:1789596847.646758:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596847.646762:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646767:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbee0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646806:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbedfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646825:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.646832:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596847.646834:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596847.646837:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671400, rc 0) 00000100:00100000:3.0:1789596847.646917:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+46:11251:x1876527961646464:12345-192.168.202.16@tcp:101:stat.0 Request processed in 1780us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596847.646927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:2.0:1789596847.774346:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596847.774651:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961646720 00000100:00100000:3.0:1789596847.774662:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961646720 00000100:00100000:2.0:1789596847.774998:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:2.0:1789596847.775011:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+46:11261:x1876527961646720:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596847.775036:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596847.775063:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07953 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596847.775170:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789596847.775295:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07953 expref: 48 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.775309:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:2.0:1789596847.775313:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596847.775320:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07953 expref: 48 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.775334:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd200, rc 0) 00000100:00100000:2.0:1789596847.775415:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+47:11261:x1876527961646720:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 408us (1080us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789596847.775455:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1789596847.780103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596847.781059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961646976 00000100:00100000:1.0:1789596847.781072:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961646976 00000100:00100000:1.0:1789596847.781147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789596847.781158:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+47:11261:x1876527961646976:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789596847.781451:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+48:11261:x1876527961646976:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 294us (1360us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789596847.781459:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789596847.860787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596847.860887:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961647232 00000100:00100000:2.0:1789596847.860898:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961647232 00000100:00100000:2.0:1789596847.860967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:2.0:1789596847.860978:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+48:11267:x1876527961647232:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596847.861001:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596847.861021:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee28 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0795a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.861140:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.861154:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.861162:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.861194:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.861206:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 49 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596847.861219:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984806144:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596847.861327:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596847.866581:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596847.866825:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961647360 00000100:00100000:0.0:1789596847.866838:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961647360 00000100:00100000:2.0:1789596847.866900:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984806144:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596847.866944:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867013:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596847.867057:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1789596847.867067:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e9184ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+50:2409:x1876527961647360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596847.867091:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596847.867099:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867113:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867136:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbee13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0794c expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867152:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:0.0:1789596847.867156:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867167:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867175:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596847.867206:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596847.867312:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e9184ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+49:2409:x1876527961647360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 245us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596847.867320:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00010000:00010000:2.0:1789596847.867330:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.867339:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596847.867357:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789596847.867579:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.867598:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.867606:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596847.867609:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596847.867611:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd800, rc 0) 00000100:00100000:2.0:1789596847.867642:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+49:11267:x1876527961647232:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6666us (6866us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789596847.867649:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000001:00080000:3.0:1789596847.875372:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000004:00080000:3.0:1789596847.875443:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789596847.875484:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7eb0399480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789596847.875489:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7e8549f100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7eb0399840 00000020:00080000:3.0:1789596847.875492:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7e8549ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d83c6fc00 00000020:00080000:0.0:1789596847.875577:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:2.0:1789596847.875717:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875730:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875737:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875757:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596847.875763:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875772:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875791:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c7d82471b00) 00010000:00010000:2.0:1789596847.875795:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1789596847.875796:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1789596847.875800:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875808:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbec84 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875831:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875836:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875841:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875846:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596847.875849:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875853:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875870:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596847.875872:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596847.875876:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875881:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbec8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875899:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875905:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875910:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875914:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596847.875916:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875921:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875927:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d82471500) 00010000:00010000:2.0:1789596847.875930:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596847.875932:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875937:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbecca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875962:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875969:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875974:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875979:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596847.875982:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875987:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.875994:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596847.875996:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596847.875999:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876005:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbedd4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876015:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876021:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876026:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876047:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596847.876050:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876056:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876065:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596847.876067:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596847.876069:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876075:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbedf7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596847.876297:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984806272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789596847.876364:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596847.876558:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984806272 00000100:00100000:2.0:1789596847.876576:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984806272 00000100:00100000:2.0:1789596847.876644:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789596847.876653:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984806272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789596847.876711:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789596847.876751:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aab14ae, atime: 0x6aab14ae, ctime: 0x6aab14ae, blocks: 0x8 00010000:00010000:2.0:1789596847.876758:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876772:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1789596847.876776:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596847.876783:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876810:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876819:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876827:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.876844:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789596847.877236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596847.877717:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876527984806272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1026us (1313us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789596847.877727:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789596847.877866:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596847.877874:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.877892:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596847.877896:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.877905:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.877920:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.877928:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bbee3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596847.877947:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596847.877949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596847.877951:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596847.878364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596847.878446:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961647616 00000100:00100000:3.0:1789596847.878455:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961647616 00000100:00100000:3.0:1789596847.878503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:3.0:1789596847.878512:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+12:11267:x1876527961647616:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:3.0:1789596847.878775:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.878791:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.878800:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596847.878839:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789596847.879180:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000469b3eb4 reply state 0000000018dc3f81 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.879195:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.879202:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596847.879206:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596847.879209:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596847.879312:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11267:x1876527961647616:12345-192.168.202.16@tcp:36:bash.0 Request processed in 799us (949us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789596847.879333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000020:00080000:3.0:1789596847.879337:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789596847.886077:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596847.886170:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961647744 00000100:00100000:2.0:1789596847.886185:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961647744 00000100:00100000:2.0:1789596847.886261:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:2.0:1789596847.886272:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11267:x1876527961647744:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596847.886297:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596847.886320:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07961 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.886433:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.886449:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.886479:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.886515:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.886529:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 16 pid: 6520 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596847.886541:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984806400:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596847.886646:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae000 going to sleep for 11 seconds 00000004:00080000:0.0:1789596847.890629:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7e85f09c00/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789596847.890646:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984806272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789596847.900944:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596847.901069:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984806400:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596847.901112:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596847.901356:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961647872 00000100:00100000:3.0:1789596847.901371:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961647872 00010000:00010000:3.0:1789596847.901437:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 17 pid: 6520 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596847.901489:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789596847.901501:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+17:2409:x1876527961647872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596847.901523:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596847.901532:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 17 pid: 6520 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.901550:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 17 pid: 6520 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.901576:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbee2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0795a expref: 17 pid: 6520 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.901599:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596847.901605:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.901617:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.901638:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596847.901970:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596847.902012:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.902026:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596847.902051:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+16:2409:x1876527961647872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 549us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596847.902062:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000004:00200000:2.0:1789596847.902105:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789596847.902112:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596847.902136:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.902175:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07961 expref: 16 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.902222:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07961 expref: 15 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596847.902232:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596847.902235:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596847.902239:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc400, rc 0) 00000100:00100000:2.0:1789596847.902314:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11267:x1876527961647744:12345-192.168.202.16@tcp:101:bash.0 Request processed in 16042us (16249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596847.902323:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789596847.914197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596847.914294:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961648128 00000100:00100000:2.0:1789596847.914305:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961648128 00000100:00100000:2.0:1789596847.914366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:2.0:1789596847.914377:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11267:x1876527961648128:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:2.0:1789596847.914633:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11267:x1876527961648128:12345-192.168.202.16@tcp:35:bash.0 Request processed in 256us (446us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789596847.914641:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789596848.048643:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.048812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961648384 00000100:00100000:2.0:1789596848.048827:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961648384 00000100:00100000:2.0:1789596848.048908:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:2.0:1789596848.048922:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11277:x1876527961648384:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596848.048956:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596848.048995:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07968 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596848.049270:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789596848.049439:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07968 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.049456:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:2.0:1789596848.049460:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596848.049468:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07968 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.049487:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd200, rc 0) 00000100:00100000:2.0:1789596848.049565:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11277:x1876527961648384:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 646us (937us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789596848.049574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:1.0:1789596848.053440:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.053594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961648512 00000100:00100000:3.0:1789596848.053609:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961648512 00000100:00100000:3.0:1789596848.053826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:3.0:1789596848.053840:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11277:x1876527961648512:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789596848.054010:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054031:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054046:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054064:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054072:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054078:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054182:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054193:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054221:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596848.054286:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054302:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054309:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054318:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054324:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.054329:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054338:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054352:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596848.054355:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.054361:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054368:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbee67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054385:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054412:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054419:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054424:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.054427:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054434:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d825db800) 00010000:00010000:3.0:1789596848.054445:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.054448:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054454:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbee6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054473:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054480:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054486:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054491:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.054500:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054507:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054515:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596848.054518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.054521:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.054526:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbee75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596848.054643:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11277:x1876527961648512:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 804us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596848.057006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:3.0:1789596848.062456:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596848.062488:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984806528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596848.062615:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596848.062881:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984806528 00000100:00100000:1.0:1789596848.062894:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984806528 00000100:00100000:1.0:1789596848.062980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789596848.062995:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984806528:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596848.063033:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000004:00000024:1.0:1789596848.063048:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1789596848.063069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961648768 00000100:00100000:0.0:1789596848.063075:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961648768 00000100:00100000:1.0:1789596848.063118:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984806528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596848.063124:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789596848.063132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789596848.063148:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11277:x1876527961648768:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789596848.063216:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984806528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596848.063426:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:11277:x1876527961648768:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 291us (394us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789596848.063433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789596848.118501:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.118869:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961649024 00000100:00100000:2.0:1789596848.118885:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961649024 00000100:00100000:2.0:1789596848.119037:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:2.0:1789596848.119050:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+18:11280:x1876527961649024:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596848.119082:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596848.119108:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0796f expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119217:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119235:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119247:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119287:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119296:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119303:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119466:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbee91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119478:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbee91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119487:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbee91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596848.119498:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789596848.119600:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119609:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.119616:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120097:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dce00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596848.120103:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120129:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120145:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596848.120148:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596848.120154:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120161:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbee83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120240:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120248:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120254:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120260:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596848.120263:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120269:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120277:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40400) 00010000:00010000:2.0:1789596848.120279:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596848.120282:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120298:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbee8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120363:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbee7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0796f expref: 21 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120382:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbee91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0796f expref: 20 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.120391:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596848.120393:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596848.120407:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dca00, rc 0) 00000100:00100000:2.0:1789596848.120493:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11280:x1876527961649024:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1446us (2007us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789596848.120502:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:1.0:1789596848.127423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596848.127537:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961649152 00000100:00100000:0.0:1789596848.127551:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961649152 00000100:00100000:0.0:1789596848.127702:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:0.0:1789596848.127716:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11280:x1876527961649152:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1789596848.127810:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.127833:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.127848:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.127901:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.127908:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.127915:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.128248:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596848.128254:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.128264:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.128281:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:0.0:1789596848.128284:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596848.128291:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.128299:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbee9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596848.128463:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11280:x1876527961649152:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 747us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596848.128473:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:1.0:1789596848.131097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.133390:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961649280 00000100:00100000:2.0:1789596848.133423:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961649280 00000100:00100000:2.0:1789596848.133729:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789596848.133744:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+20:2407:x1876527961649280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596848.133771:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596848.133806:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbee91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0796f expref: 20 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.133843:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596848.133849:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596848.134130:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:2407:x1876527961649280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 388us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.134274:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:3.0:1789596848.134815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.135733:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961649536 00000100:00100000:3.0:1789596848.135748:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961649536 00000100:00100000:3.0:1789596848.135918:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789596848.135932:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11280:x1876527961649536:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596848.136440:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11280:x1876527961649536:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 507us (1631us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789596848.139233:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789596848.363877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.363984:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961649792 00000100:00100000:3.0:1789596848.364018:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961649792 00000100:00100000:3.0:1789596848.364151:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:3.0:1789596848.364164:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11298:x1876527961649792:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:3.0:1789596848.364208:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596848.364237:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeea6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07976 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.364406:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeead lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.364425:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeead lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.364443:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeead lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596848.364456:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789596848.364615:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeea6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07976 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.364653:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeead lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07976 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.364663:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596848.364667:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789596848.364740:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670e00, rc 0) 00000100:00100000:3.0:1789596848.364847:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11298:x1876527961649792:12345-192.168.202.16@tcp:101:cat.0 Request processed in 685us (988us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789596848.364856:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:1.0:1789596848.391516:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.391733:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961649920 00000100:00100000:2.0:1789596848.391748:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961649920 00000100:00100000:2.0:1789596848.391849:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:2.0:1789596848.391863:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11299:x1876527961649920:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596848.391898:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596848.391925:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0797d expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.392271:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbeec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.392290:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.392305:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596848.392375:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789596848.392379:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596848.392414:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.392447:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbeebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0797d expref: 24 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.392472:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbeec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0797d expref: 23 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.392510:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596848.392514:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596848.392520:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc600, rc 0) 00000100:00100000:2.0:1789596848.393232:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11299:x1876527961649920:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1365us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.393245:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:2.0:1789596848.401337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.401779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961650304 00000100:00100000:3.0:1789596848.401798:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961650304 00000100:00100000:3.0:1789596848.401892:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789596848.401906:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11299:x1876527961650304:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596848.402504:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11299:x1876527961650304:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 598us (1189us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789596848.402513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1789596848.418318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596848.418428:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961650432 00000100:00100000:0.0:1789596848.418447:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961650432 00000100:00100000:0.0:1789596848.418547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789596848.418559:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11299:x1876527961650432:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:0.0:1789596848.418581:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789596848.418613:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbee52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07961 expref: 24 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.418643:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeead lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07976 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.418755:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbed48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0791b expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.418767:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:0.0:1789596848.418775:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596848.418887:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11299:x1876527961650432:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 329us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596848.418896:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789596848.423535:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596848.425458:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961650560 00000100:00100000:1.0:1789596848.425480:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961650560 00000100:00100000:1.0:1789596848.425573:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:1.0:1789596848.425586:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11299:x1876527961650560:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:1.0:1789596848.425828:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.425851:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.425876:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596848.426210:0:8967:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596848.426380:0:8967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789596848.426489:0:8967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789596848.426596:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11299:x1876527961650560:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 1009us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596848.426606:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:1.0:1789596848.463989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.464089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961650688 00000100:00100000:3.0:1789596848.464103:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961650688 00000100:00100000:3.0:1789596848.464243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:3.0:1789596848.464256:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11301:x1876527961650688:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596848.464284:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596848.464311:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeed0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07984 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464408:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464427:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464441:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464461:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464469:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464501:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464590:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464601:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.464609:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596848.464676:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789596848.465911:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596848.465964:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.465987:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466000:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466008:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466016:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466022:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.466027:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466068:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466089:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596848.466092:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.466099:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466106:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeed7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466127:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466133:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466138:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466143:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.466146:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466151:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466157:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d825db800) 00010000:00010000:3.0:1789596848.466160:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.466163:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466179:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeede lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466239:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeed0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466256:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.466263:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596848.466266:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596848.466269:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670e00, rc 0) 00000100:00100000:3.0:1789596848.466369:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11301:x1876527961650688:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2113us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596848.466379:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00010000:00010000:2.0:1789596848.573797:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596848.637979:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596848.637992:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596848.638041:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789596848.638053:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596848.638507:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984806656:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789596848.638643:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1789596848.654607:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6745180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984806656:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596848.659197:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.659746:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961650816 00000100:00100000:2.0:1789596848.659766:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961650816 00000100:00100000:2.0:1789596848.659873:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:2.0:1789596848.659889:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11312:x1876527961650816:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789596848.661132:0:11184:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789596848.661605:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11312:x1876527961650816:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 1713us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.661618:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1789596848.671628:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.671749:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961650944 00000100:00100000:3.0:1789596848.671765:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961650944 00000100:00100000:3.0:1789596848.671839:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:3.0:1789596848.671850:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11312:x1876527961650944:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.671925:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.671942:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.671954:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672020:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672028:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672061:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672069:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672075:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596848.672120:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789596848.672124:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596848.672136:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672146:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672152:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672159:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672174:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.672178:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672186:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672209:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:3.0:1789596848.672212:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.672217:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672223:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbeeec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672237:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672383:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672389:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672404:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.672407:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672413:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672432:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9c7d825db800) 00010000:00010000:3.0:1789596848.672434:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.672437:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672443:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbeef3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672459:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672465:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672471:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672477:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.672480:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672486:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672492:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596848.672494:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.672497:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.672501:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbeefa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596848.672618:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11312:x1876527961650944:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 767us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596848.672626:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:0.0:1789596848.679011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.679082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961651200 00000100:00100000:3.0:1789596848.679096:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961651200 00000100:00100000:3.0:1789596848.679176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:3.0:1789596848.679189:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11312:x1876527961651200:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.679214:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596848.679240:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbef01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e0798b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679500:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679518:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679533:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596848.679545:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789596848.679848:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679858:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679865:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679884:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.679889:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679898:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679910:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596848.679914:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596848.679919:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679927:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679973:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbef01 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0798b expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.679984:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:3.0:1789596848.679986:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596848.679990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbef01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0798b expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.680000:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671400, rc 0) 00000100:00100000:3.0:1789596848.680073:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11312:x1876527961651200:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 886us (1071us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1789596848.680083:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:2.0:1789596848.688736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596848.693210:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961651328 00000100:00100000:1.0:1789596848.693231:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961651328 00000100:00100000:1.0:1789596848.693345:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:1.0:1789596848.693359:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11312:x1876527961651328:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596848.693428:0:11184:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596848.693608:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11312:x1876527961651328:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 251us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596848.693617:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:2.0:1789596848.710973:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.711407:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961651584 00000100:00100000:3.0:1789596848.711439:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961651584 00000100:00100000:3.0:1789596848.711503:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:3.0:1789596848.711513:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11312:x1876527961651584:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.711536:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596848.711539:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789596848.711569:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbeec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0797d expref: 23 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.711602:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596848.711608:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596848.711623:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef16 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07992 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596848.712088:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789596848.712517:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.712534:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.712545:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.713887:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef16 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07992 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.713912:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07992 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.713938:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7d825db800) 00010000:00010000:3.0:1789596848.713941:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596848.713944:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db400, rc 0) 00000100:00100000:3.0:1789596848.714021:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11312:x1876527961651584:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2507us (3064us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789596848.714030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:1.0:1789596848.723004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.723124:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961651840 00000100:00100000:3.0:1789596848.723136:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961651840 00000100:00100000:3.0:1789596848.723211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:3.0:1789596848.723222:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11312:x1876527961651840:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.723293:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596848.723320:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07992 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723340:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7d825db800) 00010000:00010000:3.0:1789596848.723352:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596848.723374:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723387:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723408:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723423:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723452:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723459:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723509:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723517:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723523:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723529:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.723534:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723540:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723548:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596848.723551:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.723555:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723561:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723570:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723582:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723588:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723593:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.723596:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723603:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723611:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xbff76402 (ffff9c7d825db900) 00010000:00010000:3.0:1789596848.723614:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596848.723617:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.723623:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbff76402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596848.723759:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11312:x1876527961651840:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 538us (765us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596848.723768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:1.0:1789596848.731021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.731808:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961651968 00000100:00100000:2.0:1789596848.731829:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961651968 00000100:00100000:2.0:1789596848.731919:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:2.0:1789596848.731946:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11312:x1876527961651968:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596848.731982:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596848.732016:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07999 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.732068:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.732087:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.732101:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.732279:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.732316:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.732326:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:2.0:1789596848.732329:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596848.732334:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc000, rc 0) 00000100:00100000:2.0:1789596848.732433:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11312:x1876527961651968:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 493us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.732455:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:2.0:1789596848.750962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.751075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961652224 00000100:00100000:3.0:1789596848.751089:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961652224 00000100:00100000:3.0:1789596848.751173:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:3.0:1789596848.751186:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11312:x1876527961652224:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.751312:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.751350:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.751361:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596848.751604:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789596848.751617:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423569937695ns, next at 424569934707ns, rc = 0 00000004:00010000:3.0:1789596848.751732:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052cb82c5 reply state 00000000a08d82e7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.751749:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.751758:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:3.0:1789596848.751761:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789596848.751766:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596848.751897:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+26:11312:x1876527961652224:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 713us (949us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789596848.751906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:1.0:1789596848.754950:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.755939:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961652352 00000100:00100000:3.0:1789596848.755953:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961652352 00000100:00100000:3.0:1789596848.756026:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1789596848.756037:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+26:11312:x1876527961652352:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.756065:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596848.756088:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079a0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.756175:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.756189:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.756209:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:3.0:1789596848.756212:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596848.756216:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:3.0:1789596848.756346:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+27:11312:x1876527961652352:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 311us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596848.756354:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:1.0:1789596848.759037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.759138:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961652480 00000100:00100000:3.0:1789596848.759171:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961652480 00000100:00100000:3.0:1789596848.759238:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1789596848.759249:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1876527961652480:12345-192.168.202.16@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789596848.759525:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1789596848.759568:0:8436:0:(genops.c:1384:class_connect()) connect: client 2396ff16-3863-41e8-8748-2ac67b0298b6, cookie 0x7b5398e289bbef55 00002000:00100000:3.0:1789596848.759586:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2396ff16-3863-41e8-8748-2ac67b0298b6/ffff9c7ebfa99000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789596848.759611:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789596848.759855:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789596848.759903:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596848.760226:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2405:x1876527961652480:12345-192.168.202.16@tcp:8:lhsmtool_posix.0 Request processed in 976us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596848.760248:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:2.0:1789596848.768646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.769093:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961652608 00000100:00100000:2.0:1789596848.769107:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961652608 00000100:00100000:2.0:1789596848.769208:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789596848.769222:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:0:x1876527961652608:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789596848.770566:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789596848.776798:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1789596848.776822:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000100:00100000:2.0:1789596848.777119:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:0:x1876527961652608:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 7891us (8481us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789596848.777135:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789596848.783586:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.784067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961652864 00000100:00100000:3.0:1789596848.784080:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961652864 00000100:00100000:3.0:1789596848.784198:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789596848.784211:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+27:11312:x1876527961652864:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789596848.787764:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+28:11312:x1876527961652864:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 3534us (4176us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789596848.787785:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789596848.808207:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.808583:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961653120 00000100:00100000:2.0:1789596848.808598:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961653120 00000100:00100000:2.0:1789596848.808793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:2.0:1789596848.808807:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+28:11312:x1876527961653120:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789596848.810445:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+28:11312:x1876527961653120:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 1626us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.810462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:0.0:1789596848.826861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.826960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961653248 00000100:00100000:2.0:1789596848.826974:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961653248 00000100:00100000:2.0:1789596848.827052:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:2.0:1789596848.827065:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+28:11312:x1876527961653248:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596848.827091:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596848.827119:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbef5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.827227:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbef63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.827256:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.827271:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596848.827336:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596848.827362:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.827635:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbef5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a7 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.827659:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbef63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a7 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.827669:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:2.0:1789596848.827673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596848.827709:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dcc00, rc 0) 00000100:00100000:2.0:1789596848.827799:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11312:x1876527961653248:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 735us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.827807:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:0.0:1789596848.833886:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596848.834004:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961653376 00000100:00100000:1.0:1789596848.834018:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961653376 00000100:00100000:1.0:1789596848.834095:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789596848.834107:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961653376:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596848.834544:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596848.834579:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079ae expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596848.834613:0:9893:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab14b1, blocks: 0x0 00010000:00010000:1.0:1789596848.834640:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1789596848.834645:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596848.834658:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 6 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.835855:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 6 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.835883:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0800, rc 0) 00000100:00100000:1.0:1789596848.835974:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961653376:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1867us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596848.835983:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:3.0:1789596848.843058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596848.843137:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961653632 00000100:00100000:1.0:1789596848.843221:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961653632 00000100:00100000:1.0:1789596848.844614:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:1.0:1789596848.844635:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11312:x1876527961653632:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789596848.844818:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11312:x1876527961653632:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 191us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596848.844826:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:3.0:1789596848.856867:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.856995:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961653760 00000100:00100000:2.0:1789596848.857009:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961653760 00000100:00100000:2.0:1789596848.857090:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789596848.857127:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:11312:x1876527961653760:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596848.857166:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596848.857194:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079b5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.857239:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.857250:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596848.857255:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596848.857261:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.857317:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.857334:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596848.857351:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984806784:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596848.857483:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1789596848.861513:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984806784:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596848.861566:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.861676:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dda00, rc 0) 00000100:00100000:2.0:1789596848.861894:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11312:x1876527961653760:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 4769us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.861904:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1789596848.865250:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596848.865532:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961653888 00000100:00100000:0.0:1789596848.865548:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961653888 00010000:00010000:0.0:1789596848.865603:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596848.865771:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789596848.865784:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961653888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596848.865804:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596848.865837:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.865875:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.865909:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000204f3535/0x7b5398e289bbef6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ae expref: 7 pid: 9893 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.865944:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596848.865949:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596848.865960:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.865973:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.866027:0:7927:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596848.866045:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d835eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7927:1876527984806912:192.168.202.16@tcp:105: 00000100:00100000:0.0:1789596848.866281:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596848.872544:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d835eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7927:1876527984806912:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789596848.872610:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596848.872723:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961653888:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6940us (7487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596848.872736:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789596848.876325:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.876587:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961654016 00000100:00100000:2.0:1789596848.876600:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961654016 00002000:00100000:2.0:1789596848.876660:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c7e867e2300 x1876527961654016/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:729/0 lens 504/0 e 0 to 0 dl 1789596859 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596848.876673:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e867e2300 with x1876527961654016 ext(0->8) 00002000:00010000:2.0:1789596848.876772:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7e867e2300 00000100:00100000:2.0:1789596848.876854:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789596848.876867:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961654016:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789596848.881729:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961654016:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 4855us (5410us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789596848.881743:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:2.0:1789596848.881756:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c7e867e2300 x1876527961654016/t4294967303(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:729/0 lens 504/448 e 0 to 0 dl 1789596859 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596848.881767:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e867e2300 with x1876527961654016 ext(0->8) 00002000:00010000:2.0:1789596848.881774:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7e867e2300 00000100:00100000:3.0:1789596848.898552:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.899967:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961654144 00000100:00100000:2.0:1789596848.899994:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961654144 00000100:00100000:2.0:1789596848.900079:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:2.0:1789596848.900091:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11312:x1876527961654144:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789596848.927103:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1789596848.927123:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789596848.927175:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1789596848.927290:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596848.927313:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984807040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596848.927376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596848.927452:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984807040 00000100:00100000:2.0:1789596848.927460:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984807040 00000100:00100000:2.0:1789596848.927511:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789596848.927520:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984807040:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789596848.927553:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927566:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927574:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927580:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596848.927585:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927594:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927609:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:1.0:1789596848.927612:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596848.927617:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927623:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671000/0x7b5398e289bbee44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927639:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596848.927644:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:1.0:1789596848.927645:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596848.927649:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789596849 00002000:00010000:2.0:1789596848.927651:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789596848.927653:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789596849 -> 1789596849 00002000:00010000:2.0:1789596848.927655:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789596848.927667:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927674:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596848.927705:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927714:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596848.927724:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00000100:00100000:2.0:1789596848.927726:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984807040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (349us total) trans 4294967304 rc 0/0 00010000:00010000:1.0:1789596848.927728:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789596848.927733:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596848.927740:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1789596848.927743:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbef47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789596848.927766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789596848.927799:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7eb6744700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789596848.927805:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984807040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596848.927928:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+14:11312:x1876527961654144:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 27837us (29392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.927936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00000020:00080000:0.0:1789596848.928296:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789596848.928307:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789596848.940266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.940400:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961654272 00000100:00100000:2.0:1789596848.940411:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961654272 00000100:00100000:2.0:1789596848.940470:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:2.0:1789596848.940482:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961654272:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789596848.947841:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1789596848.947855:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1789596848.948032:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961654272:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 7546us (7768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.948055:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1789596848.959290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596848.959436:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961654528 00000100:00100000:0.0:1789596848.959446:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961654528 00000100:00100000:0.0:1789596848.959504:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1789596848.959514:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+14:11312:x1876527961654528:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596848.959575:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596848.959603:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbef63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a7 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.959622:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:0.0:1789596848.959627:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596848.959659:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.959673:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.959723:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596848.959840:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000274f04e1 reply state 0000000031f39f79 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.959852:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596848.959858:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:0.0:1789596848.959861:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596848.959874:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596848.960098:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11312:x1876527961654528:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 584us (817us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789596848.960105:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:3.0:1789596848.970612:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596848.970753:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961654656 00000100:00100000:0.0:1789596848.970764:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961654656 00000100:00100000:0.0:1789596848.970823:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789596848.970839:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961654656:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789596848.971075:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789596848.971079:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789596849 -> 1789596848 00002000:00010000:0.0:1789596848.971082:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789596846 00002000:00010000:0.0:1789596848.971084:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789596849 -> 1789596848 00002000:00010000:0.0:1789596848.971086:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789596848.971143:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961654656:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 305us (552us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789596848.971151:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789596848.979749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.979837:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961654912 00000100:00100000:2.0:1789596848.979848:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961654912 00000100:00100000:2.0:1789596848.979916:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:2.0:1789596848.979927:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+15:11312:x1876527961654912:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789596848.980009:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.980026:0:8967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.980036:0:8967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.980075:0:8967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.980090:0:8967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 15 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596848.980106:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984807168:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596848.980191:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae000 going to sleep for 11 seconds 00000100:00100000:3.0:1789596848.982346:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984807168:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596848.982373:0:8967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596848.983571:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596848.983654:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655040 00000100:00100000:2.0:1789596848.983663:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655040 00010000:00010000:2.0:1789596848.983754:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 16 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596848.983793:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789596848.983814:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+16:2409:x1876527961655040:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596848.983831:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596848.983838:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 16 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.983852:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 16 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.983888:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbef40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07999 expref: 16 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.983905:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:2.0:1789596848.983911:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.983922:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.983931:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596848.984203:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596848.984272:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+15:2409:x1876527961655040:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 459us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596848.984280:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00010000:00010000:3.0:1789596848.984814:0:8967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984826:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984865:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984872:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984880:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984886:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596848.984891:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984898:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.984910:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:3.0:1789596848.984913:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789596848.985110:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.985118:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbef7f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596848.985204:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+14:11312:x1876527961654912:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 5276us (5462us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789596848.985222:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:3.0:1789596848.997948:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596848.997994:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655168 00000100:00100000:3.0:1789596848.998004:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655168 00000100:00100000:3.0:1789596848.998057:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789596848.998068:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961655168:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789596848.998118:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.998142:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.998150:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596848.998154:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596848.998159:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.998196:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596848.998210:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 7 pid: 8437 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596848.998540:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984807296:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596848.998621:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d8364c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596849.008560:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.008889:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984807296:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596849.008929:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.009314:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655296 00000100:00100000:2.0:1789596849.009323:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655296 00010000:00010000:2.0:1789596849.009362:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 8 pid: 8437 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.009467:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789596849.009477:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961655296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596849.009494:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596849.009515:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 8 pid: 8437 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.009528:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 8 pid: 8437 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.009551:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bbef71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079b5 expref: 8 pid: 8437 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.009566:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596849.009570:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596849.009577:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.009587:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.009614:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596849.009666:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961655296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 190us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.009673:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00010000:00010000:2.0:1789596849.018924:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.018944:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.018977:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.018987:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.018996:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.019003:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789596849.019007:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.019016:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.019035:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.019044:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbef86 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.019172:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961655168:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 21099us (21227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.019183:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789596849.024270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596849.025950:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655552 00000100:00100000:1.0:1789596849.025961:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655552 00000100:00100000:1.0:1789596849.026042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:1.0:1789596849.026052:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+14:11312:x1876527961655552:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789596849.026140:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.026173:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.026183:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.026609:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.026627:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 14 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596849.026643:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984807424:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596849.026779:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679fc00 going to sleep for 11 seconds 00000100:00080000:2.0:1789596849.027348:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596849.032542:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.033127:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984807424:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596849.033171:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.033356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655680 00000100:00100000:3.0:1789596849.033364:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655680 00010000:00010000:3.0:1789596849.033420:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 15 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.033461:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:3.0:1789596849.033471:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e9184a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+15:2409:x1876527961655680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596849.033486:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596849.033493:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 15 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033505:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 15 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033529:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbedcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e0793e expref: 15 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033562:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596849.033567:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033578:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033586:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033610:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596849.033664:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e9184a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+14:2409:x1876527961655680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 195us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.033671:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00010000:00010000:3.0:1789596849.033746:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033754:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033921:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033933:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033941:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033973:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.033994:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 14 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.034010:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984807552:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596849.034057:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596849.039205:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984807552:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596849.039247:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596849.039520:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.040329:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655808 00000100:00100000:2.0:1789596849.040338:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655808 00010000:00010000:2.0:1789596849.040375:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 15 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.040429:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:2.0:1789596849.040439:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+15:2409:x1876527961655808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596849.040453:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596849.040461:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 15 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.040475:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 15 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.040499:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbef4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079a0 expref: 15 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.040516:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:2.0:1789596849.040527:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.040537:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.040545:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.040570:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596849.040620:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+14:2409:x1876527961655808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 182us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.040626:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00010000:00010000:3.0:1789596849.041655:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.041670:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596849.041802:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789596849.041939:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789596849.041976:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789596849.042058:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876527984807680:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789596849.042115:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.042151:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596849.042451:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984807680 00000100:00100000:2.0:1789596849.042459:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984807680 00000100:00100000:2.0:1789596849.042504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789596849.042513:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876527984807680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789596849.042596:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876527984807680:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.042604:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789596849.044667:0:6519:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789596849.046415:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7eb6744700, transno 4294967304 00000100:00100000:3.0:1789596849.046446:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876527984807680:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789596849.046637:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789596849.046738:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876527984807808:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789596849.046825:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.046861:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399540 going to sleep for 11 seconds 00000100:00100000:3.0:1789596849.046894:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984807808 00000100:00100000:3.0:1789596849.046900:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984807808 00000100:00100000:3.0:1789596849.046949:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789596849.046958:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1876527984807808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789596849.047111:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1876527984807808:12345-0@lo:1000:mdt00_000.0 Request processed in 153us (285us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789596849.047119:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789596849.047172:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876527984807808:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789596849.051043:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.051070:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.051078:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.051084:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596849.051089:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.051099:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.051117:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:3.0:1789596849.051121:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596849.051126:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.051152:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbef94 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.052876:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.052895:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.052903:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.052909:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596849.052913:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.053414:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.053432:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596849.053435:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596849.053439:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.053446:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbeec9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.062492:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.062524:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.062535:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.062582:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.062669:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 17 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.062996:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984807936:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596849.063181:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1789596849.070749:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984807936:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596849.070779:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.084883:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d835eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984808064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596849.084975:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596849.085124:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808064 00000100:00100000:0.0:1789596849.085133:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808064 00000100:00100000:0.0:1789596849.085195:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789596849.085206:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984808064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596849.085373:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789596849.085438:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984808064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596849.085445:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789596849.085524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d835eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984808064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596849.085805:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984808192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596849.085836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.085868:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808192 00000100:00100000:3.0:1789596849.085872:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808192 00000100:00100000:3.0:1789596849.085911:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789596849.085929:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984808192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789596849.085940:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789596849.085972:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984808192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.085978:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789596849.085993:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596849.086016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984808192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596849.096904:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.097350:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961655936 00000100:00100000:3.0:1789596849.097362:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961655936 00010000:00010000:3.0:1789596849.097415:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 18 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.097625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1789596849.097637:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+18:2408:x1876527961655936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596849.097655:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596849.097663:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 18 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.097708:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 18 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.097750:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbeee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07984 expref: 18 pid: 6521 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.097765:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:3.0:1789596849.097770:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.097780:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.097787:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.097816:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596849.097874:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+17:2408:x1876527961655936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 239us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.097882:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00010000:00010000:2.0:1789596849.098403:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098414:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098428:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098434:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098440:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098446:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.098450:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098457:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098477:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596849.098480:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.098485:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098491:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbef9b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098506:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098512:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098517:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098522:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.098525:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098533:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098539:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40500) 00010000:00010000:2.0:1789596849.098542:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596849.098545:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.098551:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbef8d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.098874:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11312:x1876527961655552:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 72819us (74660us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789596849.098884:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000020:00080000:2.0:1789596849.098889:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789596849.099139:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789596849.099144:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596849.099179:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789596849.099186:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596849.110408:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.110495:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961656192 00000100:00100000:2.0:1789596849.110507:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961656192 00000100:00100000:2.0:1789596849.110570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789596849.110584:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11312:x1876527961656192:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789596849.110906:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789596849.110958:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789596849.110999:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.111018:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.111033:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.111041:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.111048:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.111055:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.111076:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789596849.111205:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:11312:x1876527961656192:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 622us (817us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789596849.111346:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000020:00080000:2.0:1789596849.111353:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596849.111667:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596849.111675:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.111720:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596849.111725:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.111748:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.111762:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:0.0:1789596849.111765:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789596849.111771:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.111776:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbefa2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.111791:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596849.111792:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596849.111794:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596849.303086:0:14213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596849.303097:0:14213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596849.303123:0:14213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789596849.303128:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596849.500705:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.500787:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961656448 00000100:00100000:3.0:1789596849.500798:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961656448 00000100:00100000:3.0:1789596849.500864:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:3.0:1789596849.500876:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+18:11322:x1876527961656448:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596849.500903:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596849.500998:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbefa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079bc expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.501123:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbefb0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.501161:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbefb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.501174:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbefb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596849.501187:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789596849.501296:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbefa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079bc expref: 21 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.501314:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbefb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079bc expref: 20 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.501323:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596849.501326:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596849.501330:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbe00, rc 0) 00000100:00100000:3.0:1789596849.501405:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11322:x1876527961656448:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 531us (738us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789596849.501412:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:3.0:1789596849.505559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.505601:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961656576 00000100:00100000:3.0:1789596849.505612:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961656576 00000100:00100000:3.0:1789596849.505699:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:3.0:1789596849.505711:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11322:x1876527961656576:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789596849.505790:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505808:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505828:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505845:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505853:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505860:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505950:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505958:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.505965:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596849.506010:0:8967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506023:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506030:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506036:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506053:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596849.506057:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506065:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506077:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596849.506080:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596849.506085:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506091:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbefbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506101:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506107:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506113:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506119:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596849.506122:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506128:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506146:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7d825db900) 00010000:00010000:3.0:1789596849.506149:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596849.506152:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506159:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbefc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506173:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506179:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506185:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506190:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596849.506193:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506198:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506206:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7d825db800) 00010000:00010000:3.0:1789596849.506208:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596849.506212:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.506217:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbefcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.506309:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11322:x1876527961656576:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 599us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.506317:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:0.0:1789596849.568825:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.569100:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961656832 00000100:00100000:2.0:1789596849.569112:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961656832 00000100:00100000:2.0:1789596849.569180:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:2.0:1789596849.569191:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11325:x1876527961656832:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596849.569212:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596849.569233:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbefd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569310:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569326:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569337:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569350:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569357:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569363:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569519:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569528:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569535:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596849.569545:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789596849.569625:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569633:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569640:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569646:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dca00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.569651:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569659:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569672:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596849.569675:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.569705:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569723:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbefda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569737:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569743:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569748:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569752:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.569755:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569760:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569767:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:2.0:1789596849.569769:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.569772:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569777:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbefe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569816:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbefd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569831:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.569845:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.569847:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596849.569850:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc800, rc 0) 00000100:00100000:2.0:1789596849.569937:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11325:x1876527961656832:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 746us (1121us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789596849.569944:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:3.0:1789596849.573898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.574121:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961656960 00000100:00100000:2.0:1789596849.574132:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961656960 00000100:00100000:2.0:1789596849.574192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:2.0:1789596849.574203:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11325:x1876527961656960:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789596849.574271:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574288:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574301:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574336:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574344:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574352:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574358:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.574376:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574395:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574409:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.574413:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596849.574418:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.574425:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbeff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.574492:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11325:x1876527961656960:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 290us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.574500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:1.0:1789596849.577586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.577672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961657216 00000100:00100000:2.0:1789596849.577717:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961657216 00000100:00100000:2.0:1789596849.577771:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789596849.577781:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11325:x1876527961657216:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596849.578011:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:11325:x1876527961657216:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 230us (434us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789596849.578019:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789596849.601453:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984808448:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601532:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601590:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984808960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601613:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984809472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601653:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789596849.601714:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984808320:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601758:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984808832:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601783:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601801:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984809344:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601844:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984809856:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.601863:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.601890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984808576:0@lo:400:kworker.0 00010000:00010000:1.0:1789596849.602029:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596849.602046:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808320 00000100:00100000:1.0:1789596849.602053:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808320 00000100:00100000:1.0:1789596849.602101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789596849.602111:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984808320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.602165:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984808320:12345-0@lo:400:kworker.0 Request processed in 56us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596849.602188:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789596849.602238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984808320:0@lo:400:kworker.0 00000100:00100000:2.0:1789596849.602450:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596849.602460:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb6744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984809984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596849.602493:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596849.602525:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809984 00000100:00100000:2.0:1789596849.602529:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809984 00000100:00100000:2.0:1789596849.602582:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789596849.602589:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984809984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789596849.602612:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596849.602649:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984809984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.602655:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1789596849.602672:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596849.602721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb6744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984809984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596849.602740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808448 00000100:00100000:2.0:1789596849.602743:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808448 00000100:00100000:2.0:1789596849.602767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808960 00000100:00100000:2.0:1789596849.602771:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808960 00000100:00100000:2.0:1789596849.602793:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809472 00000100:00100000:2.0:1789596849.602796:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809472 00000100:00100000:2.0:1789596849.602811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789596849.602817:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984808448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596849.602850:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984808448:12345-0@lo:400:kworker.0 Request processed in 33us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.602858:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789596849.602869:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789596849.602875:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984808960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596849.602902:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984808960:12345-0@lo:400:kworker.0 Request processed in 27us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.602908:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789596849.602935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789596849.602941:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984809472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596849.602967:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984809472:12345-0@lo:400:kworker.0 Request processed in 27us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.602979:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:2.0:1789596849.602997:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596849.603122:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984808448:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.603134:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984808960:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.603143:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984809472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.603740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.603781:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984809088:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.603817:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.603855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984809600:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.603877:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.603897:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789596849.603904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984808704:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604002:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.604020:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984809216:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604045:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.604066:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984809728:0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604086:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596849.604123:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809088 00000100:00100000:3.0:1789596849.604130:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809088 00000100:00100000:3.0:1789596849.604328:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789596849.604338:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984809088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604442:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984809088:12345-0@lo:400:kworker.0 Request processed in 107us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604449:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789596849.604464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809600 00000100:00100000:3.0:1789596849.604467:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809600 00000100:00100000:3.0:1789596849.604482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808704 00000100:00100000:3.0:1789596849.604484:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808704 00000100:00100000:3.0:1789596849.604498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789596849.604503:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984809600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604531:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984809600:12345-0@lo:400:kworker.0 Request processed in 28us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789596849.604549:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789596849.604554:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984808704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604591:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984808704:12345-0@lo:400:kworker.0 Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604598:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789596849.604619:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808832 00000100:00100000:3.0:1789596849.604623:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808832 00000100:00100000:3.0:1789596849.604640:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984808576 00000100:00100000:3.0:1789596849.604642:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984808576 00000100:00100000:3.0:1789596849.604655:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789596849.604661:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984808832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604720:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984808832:12345-0@lo:400:kworker.0 Request processed in 59us (2935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604725:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789596849.604737:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789596849.604743:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984808576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604771:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984808576:12345-0@lo:400:kworker.0 Request processed in 28us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604777:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789596849.604795:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809344 00000100:00100000:3.0:1789596849.604799:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809344 00000100:00100000:3.0:1789596849.604816:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809856 00000100:00100000:3.0:1789596849.604819:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809856 00000100:00100000:3.0:1789596849.604831:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809216 00000100:00100000:3.0:1789596849.604834:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809216 00000100:00100000:3.0:1789596849.604843:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984809728 00000100:00100000:3.0:1789596849.604845:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984809728 00000100:00100000:3.0:1789596849.604856:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596849.604861:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984809344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604892:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984809344:12345-0@lo:400:kworker.0 Request processed in 30us (3066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596849.604932:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789596849.604938:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876527984809856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.604970:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876527984809856:12345-0@lo:400:kworker.0 Request processed in 32us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.604976:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789596849.604988:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789596849.604993:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984809216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.605019:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984809216:12345-0@lo:400:kworker.0 Request processed in 27us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.605025:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789596849.605036:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789596849.605042:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984809728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596849.605067:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984809728:12345-0@lo:400:kworker.0 Request processed in 25us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.605072:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789596849.605225:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984808832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.605239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984809344:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.605249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984809856:0@lo:400:kworker.0 00000100:00080000:2.0:1789596849.605667:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596849.605673:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596849.605770:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596849.605784:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984810112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596849.605824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596849.606249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984810112 00000100:00100000:2.0:1789596849.606255:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984810112 00000100:00100000:2.0:1789596849.606295:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789596849.606303:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb692e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876527984810112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789596849.606320:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596849.606365:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb692e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876527984810112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.606371:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789596849.606647:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984810112:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789596849.610319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d82799c00 x1876527984809088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596849.610340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984809088:0@lo:400:kworker.0 00010000:00080000:1.0:1789596849.615081:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8379ca80 x1876527984809600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596849.615103:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984809600:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.615145:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984808704:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.615170:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984809216:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.615183:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984809728:0@lo:400:kworker.0 00000100:00100000:1.0:1789596849.615195:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984808576:0@lo:400:kworker.0 00000100:00100000:0.0:1789596849.624258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.624356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961657472 00000100:00100000:3.0:1789596849.624367:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961657472 00000100:00100000:3.0:1789596849.624450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:3.0:1789596849.624462:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+23:10852:x1876527961657472:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596849.624490:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596849.624515:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbeffd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079ca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.624663:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.624718:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.624728:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.624763:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.624777:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 24 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.624791:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984810240:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596849.624871:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789596849.630208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596849.630474:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961657600 00000100:00100000:1.0:1789596849.630484:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961657600 00010000:00010000:1.0:1789596849.630526:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 25 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596849.630586:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789596849.630597:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+25:2408:x1876527961657600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596849.630613:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596849.630636:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 25 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.630648:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 25 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.630670:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:1.0:1789596849.630809:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.630822:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.630831:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.630852:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596849.631009:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+25:2408:x1876527961657600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 412us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596849.631017:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00010000:00010000:3.0:1789596849.631425:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbefe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079c3 expref: 24 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.631447:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984810240:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596849.631478:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.631487:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.631506:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596849.631527:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789596849.631816:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbeffd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.631834:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.631842:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:3.0:1789596849.631845:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596849.631847:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:3.0:1789596849.631886:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+24:10852:x1876527961657472:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7426us (7639us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789596849.631894:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:1.0:1789596849.635271:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.635588:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961657728 00000100:00100000:2.0:1789596849.635599:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961657728 00000100:00100000:2.0:1789596849.636880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:2.0:1789596849.636897:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+24:10852:x1876527961657728:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596849.637046:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596849.637069:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.637104:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.637118:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.637130:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.637321:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079d1 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.637338:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079d1 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.637347:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.637350:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596849.637353:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc400, rc 0) 00000100:00100000:2.0:1789596849.637426:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+25:10852:x1876527961657728:12345-192.168.202.16@tcp:101:bash.0 Request processed in 536us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.637433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:1.0:1789596849.640420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.640552:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961657984 00000100:00100000:3.0:1789596849.640563:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961657984 00000100:00100000:3.0:1789596849.640623:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:3.0:1789596849.640633:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+25:10852:x1876527961657984:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:3.0:1789596849.640892:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.640922:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.640936:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596849.641000:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789596849.641025:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c89e14be reply state 00000000c447249b transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.641038:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.641046:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:3.0:1789596849.641049:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596849.641053:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789596849.641092:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1789596849.641614:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+29:10852:x1876527961657984:12345-192.168.202.16@tcp:36:bash.0 Request processed in 979us (1199us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789596849.641623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000020:00080000:3.0:1789596849.641628:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789596849.643896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.644025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961658112 00000100:00100000:3.0:1789596849.644036:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961658112 00000100:00100000:3.0:1789596849.644101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:3.0:1789596849.644113:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+29:10852:x1876527961658112:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596849.644142:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596849.644176:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf027 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079d8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.644237:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079d8 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.644251:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079d8 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.644295:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:3.0:1789596849.644298:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596849.644302:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98daa00, rc 0) 00000100:00100000:3.0:1789596849.644360:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+30:10852:x1876527961658112:12345-192.168.202.16@tcp:101:bash.0 Request processed in 250us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.644367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:1.0:1789596849.647141:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.647285:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961658240 00000100:00100000:3.0:1789596849.647294:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961658240 00000100:00100000:3.0:1789596849.647349:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789596849.647357:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:10852:x1876527961658240:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596849.647374:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596849.647403:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079df expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596849.647427:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aab14b0, atime: 0x6aab14ae, ctime: 0x6aab14b0, blocks: 0x8 00010000:00010000:3.0:1789596849.647449:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1789596849.647453:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596849.647460:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.647479:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.647491:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:3.0:1789596849.647544:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:10852:x1876527961658240:12345-192.168.202.16@tcp:101:bash.0 Request processed in 188us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596849.647564:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:1.0:1789596849.649898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596849.650063:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961658368 00000100:00100000:0.0:1789596849.650073:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961658368 00002000:00010000:0.0:1789596849.650110:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789596849.650115:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e869bdc00 with x1876527961658368 ext(0->18446744073709551615) 00002000:00010000:0.0:1789596849.650133:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7e869bdc00. 00000100:00100000:0.0:1789596849.650172:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789596849.650181:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2406:x1876527961658368:12345-192.168.202.16@tcp:10:bash.0 00002000:00010000:0.0:1789596849.650445:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789596849.650449:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789596848 -> 1789596850 00002000:00010000:0.0:1789596849.650451:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789596846 -> 1789596846 00002000:00010000:0.0:1789596849.650454:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789596848 -> 1789596850 00002000:00010000:0.0:1789596849.650457:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789596849.650516:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2406:x1876527961658368:12345-192.168.202.16@tcp:10:bash.0 Request processed in 335us (628us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789596849.650523:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00002000:00010000:0.0:1789596849.650527:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789596849.650529:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e869bdc00 with x1876527961658368 ext(0->18446744073709551615) 00002000:00010000:0.0:1789596849.650534:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7e869bdc00. 00000100:00100000:2.0:1789596849.743852:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596849.743993:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961658496 00000100:00100000:1.0:1789596849.744004:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961658496 00000100:00100000:1.0:1789596849.744381:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:1.0:1789596849.744406:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11339:x1876527961658496:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:1.0:1789596849.744492:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744511:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744523:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744541:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744548:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744555:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744665:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744675:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744727:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596849.744775:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744802:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744809:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744815:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744821:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596849.744826:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744834:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744847:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596849.744851:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596849.744856:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744864:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf035 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744877:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744884:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744890:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744902:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596849.744905:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744922:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744931:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7eb9a7ff00) 00010000:00010000:1.0:1789596849.744934:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596849.744937:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744943:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf03c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744960:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744966:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744972:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744977:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596849.744980:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.744986:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.745004:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:1.0:1789596849.745007:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596849.745011:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.745018:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596849.745111:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11339:x1876527961658496:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 706us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596849.745120:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:3.0:1789596849.789858:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.791562:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961658752 00000100:00100000:2.0:1789596849.791578:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961658752 00000100:00100000:2.0:1789596849.792416:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789596849.792428:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11342:x1876527961658752:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596849.792451:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596849.792473:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf04a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792551:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792565:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792608:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792635:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792643:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792649:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792776:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf05f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792786:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792793:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596849.792804:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789596849.792892:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792900:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792918:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792925:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.792937:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792945:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792959:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596849.792962:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.792966:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792973:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792987:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792992:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.792998:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793004:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.793007:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793013:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793021:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:2.0:1789596849.793023:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.793033:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793039:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf058 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793083:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf04a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079e6 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793097:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf05f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079e6 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.793104:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.793107:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596849.793109:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc200, rc 0) 00000100:00100000:2.0:1789596849.793274:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11342:x1876527961658752:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 847us (3426us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789596849.793282:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789596849.801769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.801867:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961658880 00000100:00100000:3.0:1789596849.801879:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961658880 00000100:00100000:3.0:1789596849.802113:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:3.0:1789596849.802127:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11342:x1876527961658880:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789596849.802222:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.802241:0:8967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.802252:0:8967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.802290:0:8967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596849.802304:0:8967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 32 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596849.802321:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984810368:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596849.802457:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596849.805719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.805860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961659136 00000100:00100000:2.0:1789596849.805870:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961659136 00000100:00100000:2.0:1789596849.805939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789596849.805950:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+33:6178:x1876527961659136:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789596849.806469:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+34:6178:x1876527961659136:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 518us (797us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789596849.806477:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789596849.806623:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984810368:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596849.806656:0:8967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596849.809244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596849.809354:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961659264 00000100:00100000:0.0:1789596849.809363:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961659264 00010000:00010000:0.0:1789596849.809419:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 34 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596849.809500:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789596849.809511:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+34:2409:x1876527961659264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596849.809526:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596849.809533:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 34 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.809565:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 34 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.809587:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf004 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ca expref: 34 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.809605:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:0.0:1789596849.809611:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.809874:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.809884:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.809923:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596849.809987:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+33:2409:x1876527961659264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 477us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596849.809995:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00010000:00010000:2.0:1789596849.810203:0:8967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810225:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810265:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810272:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810279:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810284:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.810289:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810297:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810307:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.810309:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596849.810313:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.810319:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596849.810393:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11342:x1876527961658880:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 8258us (8797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596849.810402:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:1.0:1789596849.813972:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.814143:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961659520 00000100:00100000:3.0:1789596849.814153:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961659520 00000100:00100000:3.0:1789596849.814216:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789596849.814227:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+32:11342:x1876527961659520:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596849.814463:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+33:11342:x1876527961659520:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 237us (500us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789596849.814472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789596849.901751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596849.901856:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961659776 00000100:00100000:1.0:1789596849.901867:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961659776 00000100:00100000:1.0:1789596849.901934:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:1.0:1789596849.901944:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+33:11353:x1876527961659776:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1789596849.901970:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596849.901991:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf074 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079ed expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902068:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902083:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902095:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902128:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902136:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902142:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902804:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902816:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.902824:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596849.902834:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789596849.903067:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903076:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903082:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903088:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596849.903093:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903114:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903127:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596849.903130:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596849.903135:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903141:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf07b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903166:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903172:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903178:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903183:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596849.903186:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903192:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903200:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7eb9a7ff00) 00010000:00010000:1.0:1789596849.903203:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596849.903206:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903223:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf082 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903271:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf074 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ed expref: 36 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903286:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ed expref: 35 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596849.903293:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:1.0:1789596849.903295:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596849.903298:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0600, rc 0) 00000100:00100000:1.0:1789596849.903373:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11353:x1876527961659776:12345-192.168.202.16@tcp:101:cat.0 Request processed in 1430us (1632us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789596849.903391:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:0.0:1789596849.909063:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596849.909168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961660032 00000100:00100000:3.0:1789596849.909178:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961660032 00000100:00100000:3.0:1789596849.909238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789596849.909250:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11353:x1876527961660032:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:3.0:1789596849.909566:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+36:11353:x1876527961660032:12345-192.168.202.16@tcp:35:cat.0 Request processed in 317us (511us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789596849.909574:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789596849.938147:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.938258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961660288 00000100:00100000:2.0:1789596849.938269:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961660288 00000100:00100000:2.0:1789596849.938332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:2.0:1789596849.938343:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+36:11354:x1876527961660288:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:2.0:1789596849.938424:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789596849.938452:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079d8 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938477:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079ed expref: 35 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938489:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf05f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079e6 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938500:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079d1 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938511:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.938517:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596849.938539:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938554:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938563:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938577:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938599:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938606:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938754:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938764:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.938772:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596849.939007:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789596849.939019:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424757339254ns, next at 425757336279ns, rc = 0 00010000:00010000:2.0:1789596849.939072:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939082:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939089:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939096:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939102:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939120:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939149:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596849.939169:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939176:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939182:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939189:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.939193:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939200:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939209:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596849.939212:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789596849.939216:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939222:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939238:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939244:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939256:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939260:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dca00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.939262:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939265:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939270:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596849.939271:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.939273:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939276:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf097 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596849.939282:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071039509 reply state 00000000e8590887 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939290:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.939293:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:2.0:1789596849.939295:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596849.939297:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596849.939365:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+34:11354:x1876527961660288:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1023us (1225us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789596849.939371:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00010000:00010000:0.0:1789596849.939646:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596849.939653:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.939660:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596849.939663:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.939729:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.939739:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:0.0:1789596849.939742:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789596849.939745:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.939751:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf0ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596849.939762:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596849.939764:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596849.939765:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596849.993281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596849.993413:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961660544 00000100:00100000:2.0:1789596849.993424:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961660544 00000100:00100000:2.0:1789596849.993532:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:2.0:1789596849.993543:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+34:11360:x1876527961660544:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596849.993570:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596849.993592:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf0b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079f4 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.993741:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.993758:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.993771:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.993783:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.993792:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.993799:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596849.994438:0:8967:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789596849.994576:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994584:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994599:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994649:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994657:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994664:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994671:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596849.994707:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994715:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994725:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596849.994727:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596849.994732:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994736:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf0ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596849.994748:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1bafab3 reply state 000000003b8115a3 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994755:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994765:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:2.0:1789596849.994767:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596849.994769:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789596849.994800:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf0b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 37 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994810:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 36 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596849.994815:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:2.0:1789596849.994816:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596849.994818:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc200, rc 0) 00000100:00100000:2.0:1789596849.995438:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+37:11360:x1876527961660544:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1893us (2163us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789596849.995448:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:2.0:1789596850.000267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.000350:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961660672 00000100:00100000:3.0:1789596850.000361:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961660672 00000100:00080000:2.0:1789596850.000492:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596850.000528:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789596850.000539:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961660672:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596850.000557:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596850.000578:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e079fb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596850.000606:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789596850.000636:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1789596850.000656:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596850.000666:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.000716:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.000731:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da800, rc 0) 00000100:00100000:3.0:1789596850.000795:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961660672:12345-192.168.202.16@tcp:101:bash.0 Request processed in 258us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596850.000803:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1789596850.004953:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.005071:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961660800 00000100:00100000:3.0:1789596850.005081:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961660800 00000100:00100000:3.0:1789596850.005134:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1789596850.005144:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+8:11360:x1876527961660800:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596850.005172:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596850.005192:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a02 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.005226:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.005236:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596850.005240:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596850.005245:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.005300:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.005314:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596850.005329:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1876527984810496:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596850.005424:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596850.010287:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1876527984810496:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596850.010321:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.010339:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98daa00, rc 0) 00000100:00100000:3.0:1789596850.010406:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:11360:x1876527961660800:12345-192.168.202.16@tcp:101:bash.0 Request processed in 5263us (5462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596850.010420:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1789596850.012362:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.012454:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961660928 00000100:00100000:1.0:1789596850.012463:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961660928 00010000:00010000:1.0:1789596850.012506:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596850.012585:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1789596850.012595:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961660928:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596850.012611:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596850.012646:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.012711:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.012737:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bbf0d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079fb expref: 9 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.012754:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596850.012759:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596850.012767:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.012777:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.012814:0:7927:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596850.012827:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7927:1876527984810624:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789596850.012909:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e81652300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596850.018962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.019120:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7927:1876527984810624:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789596850.019148:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596850.019210:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961660928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6615us (6856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.019222:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:3.0:1789596850.019358:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961661184 00000100:00100000:3.0:1789596850.019366:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961661184 00000100:00100000:3.0:1789596850.019431:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789596850.019440:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+37:11360:x1876527961661184:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:3.0:1789596850.019738:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11360:x1876527961661184:12345-192.168.202.16@tcp:35:bash.0 Request processed in 298us (786us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789596850.019746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789596850.202446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.202671:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961661312 00000100:00100000:1.0:1789596850.202714:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961661312 00000100:00100000:1.0:1789596850.202780:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:1.0:1789596850.202791:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+38:11376:x1876527961661312:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596850.202837:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596850.202861:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf0e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a09 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.202957:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf0eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.202973:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.202988:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596850.203037:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789596850.203042:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596850.203063:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.203090:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf0e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a09 expref: 40 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.203110:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf0eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a09 expref: 39 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.203279:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596850.203283:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596850.203287:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0200, rc 0) 00000100:00100000:1.0:1789596850.203356:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+39:11376:x1876527961661312:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 566us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596850.203363:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:0.0:1789596850.209332:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.209520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961661568 00000100:00100000:3.0:1789596850.209532:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961661568 00000100:00100000:3.0:1789596850.209595:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:3.0:1789596850.209605:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+39:11376:x1876527961661568:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596850.209635:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596850.209656:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf0f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a10 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.209810:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.209826:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.209839:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596850.209850:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789596850.209979:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf0f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a10 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.209999:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a10 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.210007:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:3.0:1789596850.210010:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596850.210014:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:3.0:1789596850.210079:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+41:11376:x1876527961661568:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 476us (759us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789596850.210104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:3.0:1789596850.214059:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.214214:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961661696 00000100:00100000:2.0:1789596850.214225:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961661696 00000100:00100000:2.0:1789596850.214295:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789596850.214306:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+41:2407:x1876527961661696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596850.214341:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596850.214369:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a10 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.214405:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:2.0:1789596850.214410:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596850.214474:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+40:2407:x1876527961661696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 170us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.214482:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789596850.220814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.220914:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961661952 00000100:00100000:2.0:1789596850.220925:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961661952 00000100:00100000:2.0:1789596850.220989:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:2.0:1789596850.221000:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+40:11376:x1876527961661952:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596850.221027:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596850.221048:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf107 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a17 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.221205:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf10e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.221221:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf10e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.221234:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf10e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596850.221246:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789596850.221352:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf107 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a17 expref: 43 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.221392:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf10e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a17 expref: 42 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.221402:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:2.0:1789596850.221405:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789596850.221409:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd600, rc 0) 00000100:00100000:2.0:1789596850.221472:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+42:11376:x1876527961661952:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 473us (668us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789596850.221479:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:3.0:1789596850.228495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.228726:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961662080 00000100:00100000:0.0:1789596850.228738:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961662080 00000100:00100000:0.0:1789596850.228807:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789596850.228819:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961662080:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:0.0:1789596850.228869:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.228890:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.228900:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789596850.228931:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596850.228936:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.228976:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.228994:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 8 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596850.229011:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876527984810752:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596850.229121:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596850.231279:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876527984810752:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596850.231305:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596850.233613:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.233715:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961662208 00000100:00100000:2.0:1789596850.233725:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961662208 00002000:00100000:2.0:1789596850.233779:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c7e85f0bb80 x1876527961662208/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:731/0 lens 504/0 e 0 to 0 dl 1789596861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596850.233790:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e85f0bb80 with x1876527961662208 ext(0->8) 00010000:00010000:2.0:1789596850.233799:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 9 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.233816:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 9 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596850.233824:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7e85f0bb80 00000100:00100000:2.0:1789596850.233858:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:2.0:1789596850.233868:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961662208:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:2.0:1789596850.235603:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2408:x1876527961662208:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 1727us (1990us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789596850.235630:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00002000:00100000:2.0:1789596850.235642:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c7e85f0bb80 x1876527961662208/t4294967303(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:731/0 lens 504/448 e 0 to 0 dl 1789596861 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596850.235652:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e85f0bb80 with x1876527961662208 ext(0->8) 00010000:00010000:2.0:1789596850.235662:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 11 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.236975:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 11 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596850.236993:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7e85f0bb80 00000100:00100000:3.0:1789596850.239079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.239190:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961662336 00000100:00100000:2.0:1789596850.239272:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961662336 00010000:00010000:2.0:1789596850.239329:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 11 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.239373:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1789596850.239394:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e91849450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2408:x1876527961662336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596850.239411:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789596850.239430:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789596850.239434:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789596850 00002000:00010000:2.0:1789596850.239436:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789596850 00002000:00010000:2.0:1789596850.239438:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789596850 00002000:00010000:2.0:1789596850.239441:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789596850.239448:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 11 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.239479:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 11 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.239505:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bbf0dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a02 expref: 11 pid: 8436 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.239525:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596850.239529:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596850.239536:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.239546:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.239629:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596850.239718:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e91849450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2408:x1876527961662336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 326us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.239726:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00010000:00010000:0.0:1789596850.241126:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241143:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241290:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241300:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241328:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241335:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596850.241340:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241350:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241368:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.241376:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf11c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596850.241541:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961662080:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 12719us (13052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596850.241552:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789596850.245984:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.246095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961662592 00000100:00100000:1.0:1789596850.246108:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961662592 00000100:00100000:1.0:1789596850.246310:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789596850.246326:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+42:11376:x1876527961662592:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:1.0:1789596850.246411:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf10e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a17 expref: 42 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596850.246659:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789596850.246729:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789596850.247069:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789596850.247107:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.247124:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 46 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.247134:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.247471:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 46 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.247489:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 46 pid: 8967 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596850.247504:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876527984810880:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596850.247698:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91782900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596850.251600:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.251708:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876527984810880:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596850.251736:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.252032:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961662720 00000100:00100000:2.0:1789596850.252040:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961662720 00010000:00010000:2.0:1789596850.252077:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 47 pid: 8967 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.252117:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:2.0:1789596850.252127:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+47:2409:x1876527961662720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596850.252164:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596850.252172:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 47 pid: 8967 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.252185:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 47 pid: 8967 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.252226:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf0c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079f4 expref: 47 pid: 8967 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.252245:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:2.0:1789596850.252250:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.252262:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.252270:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.252293:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596850.252371:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.252400:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596850.252509:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789596850.252616:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789596850.252745:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984811008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789596850.252790:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596850.252822:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596850.254233:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+48:2409:x1876527961662720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2096us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.254244:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:2.0:1789596850.255061:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984811008 00000100:00100000:2.0:1789596850.255073:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984811008 00000100:00100000:2.0:1789596850.255120:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789596850.255130:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876527984811008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789596850.255280:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876527984811008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.255302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789596850.256480:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984811008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789596850.256668:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1789596850.256896:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984811136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789596850.257017:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596850.257046:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596850.257099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984811136 00000100:00100000:2.0:1789596850.257106:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984811136 00000100:00100000:2.0:1789596850.257161:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789596850.257171:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876527984811136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789596850.257446:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6523:x1876527984811136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 275us (428us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789596850.257455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789596850.257545:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984811136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789596850.257607:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789596850.257656:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.257665:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.257673:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.257706:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596850.257711:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.257720:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.257736:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:1.0:1789596850.257739:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789596850.257744:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.257750:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf123 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596850.257851:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789596850.258335:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789596850.258349:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425076669362ns, next at 426076666300ns, rc = 0 00000001:00080000:1.0:1789596850.258356:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789596850.258393:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40100) 00010000:00010000:1.0:1789596850.258397:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789596850.258411:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf10e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a17 expref: 50 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596850.258502:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+49:11376:x1876527961662592:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 12181us (12527us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789596850.258510:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000020:00080000:1.0:1789596850.258515:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789596850.261707:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.261810:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961662848 00000100:00100000:2.0:1789596850.261820:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961662848 00000100:00100000:2.0:1789596850.261883:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:2.0:1789596850.261892:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+49:11376:x1876527961662848:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596850.261924:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596850.261948:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf12a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.262009:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf12a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a1e expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.262023:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf12a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a1e expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.262039:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.262042:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596850.262045:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dca00, rc 0) 00000100:00100000:2.0:1789596850.262396:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+50:11376:x1876527961662848:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 504us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.262417:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:3.0:1789596850.265882:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.265979:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961663104 00000100:00100000:2.0:1789596850.265991:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961663104 00000100:00100000:2.0:1789596850.266054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1789596850.266065:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+50:11376:x1876527961663104:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596850.266322:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+51:11376:x1876527961663104:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 258us (448us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789596850.266330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:0.0:1789596850.382229:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.382302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961663232 00000100:00100000:3.0:1789596850.382311:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961663232 00000100:00100000:3.0:1789596850.382361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:3.0:1789596850.382371:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e859cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+51:11386:x1876527961663232:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789596850.382466:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382484:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382496:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382504:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382510:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382514:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382765:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382774:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382780:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596850.382830:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382842:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382848:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382855:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382861:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596850.382865:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382872:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.382883:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596850.382886:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596850.382890:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383154:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf131 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383172:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383178:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383183:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383188:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596850.383191:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383724:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383739:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:3.0:1789596850.383742:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596850.383746:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383752:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf138 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383763:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383768:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383783:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383789:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596850.383792:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383798:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383806:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:3.0:1789596850.383808:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596850.383811:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.383817:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf13f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596850.383955:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e859cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+51:11386:x1876527961663232:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 1576us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596850.383962:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:1.0:1789596850.447025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.447137:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961663488 00000100:00100000:0.0:1789596850.447148:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961663488 00000100:00100000:0.0:1789596850.447206:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:0.0:1789596850.447215:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+51:11389:x1876527961663488:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596850.447234:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596850.447252:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf146 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a25 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447318:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447332:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447371:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447411:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447419:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447426:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447526:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447533:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447551:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596850.447560:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789596850.447625:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447633:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447640:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447645:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596850.447655:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447663:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447674:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:0.0:1789596850.447714:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596850.447719:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447726:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf14d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447738:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447744:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447750:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447755:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596850.447758:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447763:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447769:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:0.0:1789596850.447771:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596850.447779:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447785:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447828:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf146 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 54 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447842:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 53 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.447849:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596850.447852:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596850.447854:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596850.447921:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+53:11389:x1876527961663488:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 707us (905us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789596850.447928:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:0.0:1789596850.457093:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.457557:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961663616 00000100:00100000:2.0:1789596850.457569:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961663616 00000100:00100000:2.0:1789596850.457641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:2.0:1789596850.457652:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+53:11389:x1876527961663616:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789596850.457769:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457799:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457815:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457853:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457859:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457866:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457888:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596850.457893:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457911:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457924:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.457927:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596850.457932:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.457939:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.458015:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+53:11389:x1876527961663616:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 364us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.458024:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:3.0:1789596850.462496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.462788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961663872 00000100:00100000:2.0:1789596850.462810:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961663872 00000100:00100000:2.0:1789596850.462871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:2.0:1789596850.462882:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+53:11389:x1876527961663872:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596850.463372:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+54:11389:x1876527961663872:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 490us (887us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789596850.463390:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789596850.558552:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.558633:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961664128 00000100:00100000:3.0:1789596850.558645:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961664128 00000100:00100000:3.0:1789596850.558736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:3.0:1789596850.558748:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+54:11398:x1876527961664128:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596850.558774:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596850.558778:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789596850.558806:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf0eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a09 expref: 54 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.558841:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:3.0:1789596850.558846:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596850.558860:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf170 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a2c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.558986:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.559002:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 54 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.559010:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.559043:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 54 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.559068:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 54 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596850.559084:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811264:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596850.559203:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596850.562983:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.563116:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811264:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596850.563120:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961664256 00000100:00100000:2.0:1789596850.563131:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961664256 00010000:00010000:3.0:1789596850.563146:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563175:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 55 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.563236:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:2.0:1789596850.563246:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+55:2409:x1876527961664256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596850.563278:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596850.563287:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 55 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563309:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 55 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563335:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf15b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a25 expref: 55 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563353:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.563358:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563369:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563386:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.563416:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596850.563449:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.563465:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.563474:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+54:2409:x1876527961664256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 228us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.563483:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000004:00200000:3.0:1789596850.563487:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789596850.563637:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf170 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.563653:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.563661:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:3.0:1789596850.563663:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596850.563666:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db400, rc 0) 00000100:00100000:3.0:1789596850.563733:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+54:11398:x1876527961664128:12345-192.168.202.16@tcp:101:bash.0 Request processed in 4987us (5190us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789596850.563741:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:0.0:1789596850.568806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.568926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961664384 00000100:00100000:1.0:1789596850.568937:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961664384 00000100:00100000:1.0:1789596850.569001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1789596850.569012:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+54:11398:x1876527961664384:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789596850.569037:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596850.569060:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.569096:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.569110:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.569121:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.569245:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.569264:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.569280:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:1.0:1789596850.569283:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596850.569287:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1000, rc 0) 00000100:00100000:1.0:1789596850.569351:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+55:11398:x1876527961664384:12345-192.168.202.16@tcp:101:bash.0 Request processed in 340us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596850.569358:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1789596850.572809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.573179:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961664640 00000100:00100000:0.0:1789596850.573193:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961664640 00000100:00100000:0.0:1789596850.573259:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:0.0:1789596850.573269:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+55:11398:x1876527961664640:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:0.0:1789596850.573500:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.573518:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.573546:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596850.573592:0:8967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789596850.573614:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd9c4d11 reply state 00000000546246a6 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.573628:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.573636:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596850.573639:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596850.573643:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596850.573770:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+58:11398:x1876527961664640:12345-192.168.202.16@tcp:36:bash.0 Request processed in 502us (970us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789596850.573778:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000020:00080000:0.0:1789596850.573783:0:8967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789596850.577211:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596850.577509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961664768 00000100:00100000:3.0:1789596850.577520:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961664768 00000100:00100000:3.0:1789596850.577583:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:3.0:1789596850.577594:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+58:11398:x1876527961664768:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596850.577620:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596850.577639:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf19a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a3a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.577799:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.577824:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.577834:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.577867:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596850.577881:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 59 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596850.577895:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811392:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596850.577983:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596850.581115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.581267:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961664896 00000100:00100000:0.0:1789596850.581277:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961664896 00010000:00010000:0.0:1789596850.581319:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 60 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596850.581366:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789596850.581387:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+60:2409:x1876527961664896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596850.581404:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596850.581411:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 60 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.581444:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 60 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.581465:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596850.581470:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.581481:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.581489:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.581507:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596850.581566:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+60:2409:x1876527961664896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 190us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596850.581574:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00010000:00010000:2.0:1789596850.582185:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf177 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a2c expref: 59 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.582212:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811392:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596850.582234:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.582243:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.582249:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596850.582301:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789596850.582306:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596850.582326:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.582358:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf19a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.582373:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.582394:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.582397:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596850.582399:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da800, rc 0) 00000100:00100000:2.0:1789596850.582447:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+58:11398:x1876527961664768:12345-192.168.202.16@tcp:101:bash.0 Request processed in 4855us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.582454:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:3.0:1789596850.587837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.587938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961665152 00000100:00100000:1.0:1789596850.587949:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961665152 00000100:00100000:1.0:1789596850.588006:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789596850.588017:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+58:11398:x1876527961665152:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:1.0:1789596850.588256:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+59:11398:x1876527961665152:12345-192.168.202.16@tcp:35:bash.0 Request processed in 240us (427us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789596850.588263:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00010000:00010000:0.0:1789596850.624799:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596850.652115:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.652229:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961665280 00000100:00100000:0.0:1789596850.652240:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961665280 00000100:00100000:0.0:1789596850.652455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:0.0:1789596850.652466:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+59:11405:x1876527961665280:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596850.652492:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596850.652516:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf1a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.652812:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf1af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.652835:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.652848:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596850.653252:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789596850.653257:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596850.653350:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.653456:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf1a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a41 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.653476:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf1af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a41 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.653484:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:0.0:1789596850.653487:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596850.653491:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742800, rc 0) 00000100:00100000:0.0:1789596850.653632:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+60:11405:x1876527961665280:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1167us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596850.653640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:0.0:1789596850.660062:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.660715:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961665408 00000100:00100000:1.0:1789596850.660726:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961665408 00000100:00100000:1.0:1789596850.660794:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:1.0:1789596850.660805:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+60:11405:x1876527961665408:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596850.660825:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596850.660846:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf1b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a48 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.660923:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.660955:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.660967:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.660979:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.660986:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.660992:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661068:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661077:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661084:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596850.661126:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789596850.661130:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596850.661148:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661159:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661177:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661184:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661190:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661196:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596850.661200:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661207:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661219:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596850.661222:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596850.661227:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661233:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf1bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661245:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661250:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661255:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661281:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596850.661284:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661290:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661298:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:1.0:1789596850.661300:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596850.661303:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661309:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf1c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661341:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf1b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 62 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661365:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 61 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.661373:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:1.0:1789596850.661384:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596850.661387:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0e00, rc 0) 00000100:00100000:1.0:1789596850.661459:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11405:x1876527961665408:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 655us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596850.661466:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789596850.666615:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.668587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.668747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961665792 00000100:00100000:2.0:1789596850.668757:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961665792 00000100:00100000:2.0:1789596850.668822:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:2.0:1789596850.668833:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11405:x1876527961665792:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596850.668858:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596850.668881:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf1d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a4f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669012:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669029:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669037:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 62 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669046:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669084:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 62 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669098:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 62 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.669113:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811520:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596850.669242:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.669260:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.669269:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811648:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596850.669296:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e8679f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596850.673015:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961665536 00000100:00100000:1.0:1789596850.673047:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961665536 00010000:00010000:1.0:1789596850.673095:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 63 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596850.673140:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:1.0:1789596850.673151:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+63:2408:x1876527961665536:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596850.673167:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596850.673175:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 63 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.673189:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 63 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.673210:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:1.0:1789596850.673216:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.673236:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596850.673242:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596850.673311:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+63:2408:x1876527961665536:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 161us (6704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596850.673319:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00010000:00010000:2.0:1789596850.674781:0:6520:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.16@tcp) returned -22 from blocking AST (req@00000000758f5475 x1876527984811520) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 62 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.674801:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a48 expref: 62 pid: 11184 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596850.674817:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811520:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596850.674829:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984811648:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596850.674849:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.674854:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.674862:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.674871:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596850.675201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596850.675277:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961665920 00000100:00100000:0.0:1789596850.675283:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961665920 00010000:00010000:0.0:1789596850.675313:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596850.675372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:0.0:1789596850.675389:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+62:2409:x1876527961665920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596850.675403:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596850.675409:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.675419:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.675437:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf1a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a3a expref: 62 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.675447:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596850.675451:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.675459:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.675466:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.675493:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596850.675547:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+61:2409:x1876527961665920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 160us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596850.675555:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00010000:00010000:2.0:1789596850.675932:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.675962:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596850.675982:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789596850.676112:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf1d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.676130:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.676138:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.676141:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596850.676144:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc200, rc 0) 00000100:00100000:2.0:1789596850.676184:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11405:x1876527961665792:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 7353us (7616us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789596850.676192:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:3.0:1789596850.680370:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.681085:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961666176 00000100:00100000:2.0:1789596850.681098:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961666176 00000100:00100000:2.0:1789596850.681281:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789596850.681293:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11405:x1876527961666176:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:2.0:1789596850.681310:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596850.681331:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf12a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a1e expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.681346:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.681351:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596850.682196:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+60:11405:x1876527961666176:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 901us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.682206:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789596850.692554:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596850.693067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961666304 00000100:00100000:1.0:1789596850.693077:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961666304 00000100:00100000:0.0:1789596850.693240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:0.0:1789596850.693252:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+60:11405:x1876527961666304:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:0.0:1789596850.693464:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.693482:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596850.693494:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596850.693863:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789596850.694006:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+60:11405:x1876527961666304:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 754us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596850.694015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:3.0:1789596850.696441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596850.696497:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961666432 00000100:00100000:2.0:1789596850.696504:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961666432 00000100:00100000:2.0:1789596850.696581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789596850.696596:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+60:11405:x1876527961666432:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596850.696617:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596850.696632:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a56 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.696674:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.696709:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.696723:0:6519:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.696732:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.696742:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596850.696744:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596850.696746:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596850.696752:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dca00, rc 0) 00000100:00100000:2.0:1789596850.696801:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11405:x1876527961666432:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 207us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596850.696806:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789596851.133698:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596851.133721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984811776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596851.133811:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596851.134126:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984811776 00000100:00100000:3.0:1789596851.134136:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984811776 00000100:00100000:3.0:1789596851.134190:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789596851.134200:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984811776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596851.134236:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596851.134292:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984811776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.134316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789596851.134364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984811776:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789596851.134710:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596851.134715:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596851.134771:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789596851.134786:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596851.135186:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83cd6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984811904:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596851.135261:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596851.149559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.149719:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961666560 00000100:00100000:2.0:1789596851.149729:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961666560 00000100:00100000:2.0:1789596851.149814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:2.0:1789596851.149826:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961666560:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789596851.149890:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1789596851.150253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596851.150536:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961666560:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 711us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596851.150545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:0.0:1789596851.154320:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83cd6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984811904:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596851.165472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596851.166100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961666688 00000100:00100000:0.0:1789596851.166111:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961666688 00000100:00100000:0.0:1789596851.166177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:0.0:1789596851.166188:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11406:x1876527961666688:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789596851.166260:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166292:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166304:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166322:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166330:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166337:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166361:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166389:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596851.166437:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789596851.166442:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596851.166455:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166467:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166484:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166492:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166498:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596851.166502:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166510:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.166522:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:0.0:1789596851.166525:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596851.166530:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167080:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf1f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167098:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167105:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167111:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167117:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596851.167129:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167137:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167147:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9c7d833d8900) 00010000:00010000:0.0:1789596851.167150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596851.167153:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167160:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf1fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167175:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167181:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167187:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167192:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596851.167196:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167202:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167210:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596851.167212:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596851.167221:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.167228:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596851.167323:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11406:x1876527961666688:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 1134us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.167333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:1.0:1789596851.174401:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.174899:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961666944 00000100:00100000:2.0:1789596851.174915:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961666944 00000100:00100000:2.0:1789596851.174991:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1789596851.175003:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+61:11406:x1876527961666944:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596851.175027:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596851.175052:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf20a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175183:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175201:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175236:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596851.175247:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789596851.175327:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175334:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175340:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175346:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dcc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.175350:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175357:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175368:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.175383:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596851.175389:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175394:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175441:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf20a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a5d expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175464:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:2.0:1789596851.175466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596851.175470:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf20a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a5d expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.175481:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dce00, rc 0) 00000100:00100000:2.0:1789596851.175552:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d826c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961666944:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 552us (1161us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789596851.175560:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:3.0:1789596851.180915:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.181452:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667072 00000100:00100000:2.0:1789596851.181469:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667072 00000100:00100000:2.0:1789596851.181558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:2.0:1789596851.181570:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961667072:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789596851.181605:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789596851.181816:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961667072:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 248us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596851.181833:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1789596851.188627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.188742:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667328 00000100:00100000:2.0:1789596851.188754:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667328 00000100:00100000:2.0:1789596851.188819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:2.0:1789596851.188838:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961667328:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596851.188861:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596851.188873:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789596851.188909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf1af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a41 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.188961:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:2.0:1789596851.188967:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596851.188983:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf21f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a64 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596851.189350:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789596851.189500:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.189514:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.189525:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.189574:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf21f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a64 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.189590:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a64 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.189598:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7e92a40f00) 00010000:00010000:2.0:1789596851.189601:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596851.189604:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dcc00, rc 0) 00000100:00100000:2.0:1789596851.189672:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+63:11406:x1876527961667328:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 844us (1065us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789596851.189735:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:1.0:1789596851.196280:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.196321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.196385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.196422:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.196451:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.196473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.196499:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667968 00000100:00100000:1.0:1789596851.196508:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667968 00000100:00100000:1.0:1789596851.196579:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667584 00000100:00100000:1.0:1789596851.196583:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667584 00000100:00100000:1.0:1789596851.196604:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961668096 00000100:00100000:0.0:1789596851.197248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667456 00000100:00100000:0.0:1789596851.197256:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667456 00000100:00100000:0.0:1789596851.197299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 389 00000100:00100000:0.0:1789596851.197309:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961667456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596851.197396:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961667456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 88us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.197403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 389 00000100:00100000:0.0:1789596851.198058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 318 00000100:00100000:0.0:1789596851.198070:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961667968:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596851.198114:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961667968:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.198120:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 318 00000100:00100000:0.0:1789596851.198140:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 319 00000100:00100000:0.0:1789596851.198147:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961667584:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596851.198170:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961667584:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.198193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 319 00000100:00100000:3.0:1789596851.198806:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667712 00000100:00100000:3.0:1789596851.198813:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667712 00000100:00100000:3.0:1789596851.198947:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961667840 00000100:00100000:3.0:1789596851.198951:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961667840 00000100:00100000:3.0:1789596851.198977:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1789596851.198985:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961667712:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596851.199028:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961667712:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.199036:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1789596851.199049:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:3.0:1789596851.199057:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961667840:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596851.199083:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961667840:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.199089:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00080000:3.0:1789596851.199111:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596851.199115:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789596851.199118:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596851.199120:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596851.199172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.199629:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961668096 00000100:00100000:1.0:1789596851.199649:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961668352 00000100:00100000:1.0:1789596851.199652:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961668352 00000100:00100000:1.0:1789596851.199710:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:1.0:1789596851.199720:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+63:11406:x1876527961668352:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789596851.199780:0:11184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596851.199806:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a64 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.199963:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7e92a40f00) 00010000:00010000:1.0:1789596851.199975:0:11184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596851.199997:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200013:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200023:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200091:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200112:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200119:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200163:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200172:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200179:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200184:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596851.200189:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200196:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200203:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596851.200206:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596851.200210:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200215:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf234 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200225:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200238:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200243:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200248:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596851.200251:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200257:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200265:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x315d7bb2 (ffff9c7eb9a7ff00) 00010000:00010000:1.0:1789596851.200268:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596851.200271:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.200276:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf23b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x315d7bb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.200339:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961668352:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 622us (1167us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789596851.200346:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00080000:1.0:1789596851.200449:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596851.200478:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:1.0:1789596851.200486:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961668096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596851.200521:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961668096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (4046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.200535:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:1.0:1789596851.206481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.206559:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961668480 00000100:00100000:3.0:1789596851.206587:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961668480 00000100:00100000:3.0:1789596851.206662:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:3.0:1789596851.206672:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+62:11406:x1876527961668480:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.206714:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596851.206742:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a6b expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.206782:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.206796:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.206809:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.206932:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 64 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.206951:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 63 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.206961:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596851.206964:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789596851.206968:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da800, rc 0) 00000100:00100000:3.0:1789596851.207037:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+63:11406:x1876527961668480:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 366us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.207045:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:1.0:1789596851.213367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.213549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961668736 00000100:00100000:2.0:1789596851.213560:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961668736 00000100:00100000:2.0:1789596851.213638:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:2.0:1789596851.213651:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+63:11406:x1876527961668736:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789596851.213762:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.213778:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.213791:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596851.213960:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789596851.213970:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426032290880ns, next at 427032287337ns, rc = 0 00000004:00010000:2.0:1789596851.214034:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082d21453 reply state 00000000bf0cf06f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.214046:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.214055:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:2.0:1789596851.214058:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789596851.214062:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596851.214172:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+65:11406:x1876527961668736:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 523us (816us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789596851.214180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:2.0:1789596851.223719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.223812:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961668864 00000100:00100000:3.0:1789596851.223836:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961668864 00000100:00100000:3.0:1789596851.223894:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1789596851.223914:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+65:11406:x1876527961668864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.223941:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596851.223961:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a72 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.224039:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.224054:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.224073:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596851.224076:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596851.224080:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98daa00, rc 0) 00000100:00100000:3.0:1789596851.224134:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+66:11406:x1876527961668864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 231us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.224141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:1.0:1789596851.228807:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.229005:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961668992 00000100:00100000:3.0:1789596851.229022:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961668992 00000100:00100000:3.0:1789596851.229102:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1789596851.229115:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961668992:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789596851.229444:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961668992:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 330us (645us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789596851.229452:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789596851.232933:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.233208:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961669248 00000100:00100000:1.0:1789596851.233234:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961669248 00000100:00100000:1.0:1789596851.233316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789596851.233326:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+66:11406:x1876527961669248:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789596851.233587:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+67:11406:x1876527961669248:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 261us (669us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789596851.233606:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789596851.239144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.239314:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961669504 00000100:00100000:3.0:1789596851.239366:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961669504 00000100:00100000:3.0:1789596851.239465:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:3.0:1789596851.239482:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+67:11406:x1876527961669504:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789596851.239736:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+67:11406:x1876527961669504:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 258us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.239748:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:3.0:1789596851.244236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.244589:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961669632 00000100:00100000:1.0:1789596851.244605:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961669632 00000100:00100000:1.0:1789596851.244736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:1.0:1789596851.244752:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+67:11406:x1876527961669632:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596851.244783:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596851.244815:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf25e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a79 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.244932:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.244951:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.244967:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596851.245068:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596851.245108:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.245154:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf25e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a79 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.245178:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a79 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.245189:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:1.0:1789596851.245192:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789596851.245197:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1600, rc 0) 00000100:00100000:1.0:1789596851.245281:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+68:11406:x1876527961669632:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 534us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.245289:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:0.0:1789596851.248837:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.249028:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961669760 00000100:00100000:3.0:1789596851.249045:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961669760 00000100:00100000:3.0:1789596851.249113:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789596851.249123:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961669760:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.249142:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596851.249165:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a80 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596851.249194:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab14b3, blocks: 0x0 00010000:00010000:3.0:1789596851.249215:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1789596851.249233:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596851.249420:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.249442:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.249457:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:3.0:1789596851.249527:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2409:x1876527961669760:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 405us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.249546:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1789596851.259510:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.262575:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670016 00000100:00100000:1.0:1789596851.262599:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670016 00000100:00100000:1.0:1789596851.264466:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:1.0:1789596851.264484:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+68:11406:x1876527961670016:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789596851.264670:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+68:11406:x1876527961670016:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 190us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.264702:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:1.0:1789596851.271342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.271608:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670144 00000100:00100000:3.0:1789596851.271618:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670144 00000100:00100000:3.0:1789596851.271676:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1789596851.271711:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+10:11406:x1876527961670144:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.271731:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596851.271749:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a87 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.271781:0:9893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.271790:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596851.271794:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596851.271799:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 11 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.271833:0:9893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.271847:0:9893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 11 pid: 8435 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.271862:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984812032:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596851.271984:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596851.276427:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.276670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670272 00000100:00100000:2.0:1789596851.276733:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670272 00010000:00010000:2.0:1789596851.276792:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 12 pid: 8435 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596851.276798:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984812032:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596851.276858:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00010000:00010000:0.0:1789596851.276864:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 12 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.276883:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e9184b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+12:2409:x1876527961670272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596851.276902:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db400, rc 0) 00010000:00010000:2.0:1789596851.276904:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596851.276932:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 12 pid: 8435 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.276947:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 12 pid: 8435 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.276974:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bbf26c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a80 expref: 12 pid: 8435 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596851.276986:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+12:11406:x1876527961670144:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 5274us (5649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.276998:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00010000:00010000:2.0:1789596851.276999:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596851.277007:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596851.277018:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 10 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.277030:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 10 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.277074:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 10 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.277105:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876527984812160:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789596851.277187:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596851.280670:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876527984812160:192.168.202.16@tcp:105: 00010000:00010000:0.0:1789596851.280743:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596851.280799:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e9184b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2409:x1876527961670272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3930us (4386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.280810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:1.0:1789596851.283933:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596851.284087:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670400 00000100:00100000:0.0:1789596851.284098:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670400 00002000:00100000:0.0:1789596851.284150:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c7d8379dc00 x1876527961670400/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:732/0 lens 504/0 e 0 to 0 dl 1789596862 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596851.284162:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d8379dc00 with x1876527961670400 ext(0->12) 00002000:00010000:0.0:1789596851.284168:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d8379dc00 00000100:00100000:0.0:1789596851.284202:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1789596851.284212:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2409:x1876527961670400:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789596851.285398:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+12:2409:x1876527961670400:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 1180us (1466us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789596851.285409:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00002000:00100000:0.0:1789596851.285420:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c7d8379dc00 x1876527961670400/t4294967309(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:732/0 lens 504/448 e 0 to 0 dl 1789596862 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596851.285430:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d8379dc00 with x1876527961670400 ext(0->12) 00002000:00010000:0.0:1789596851.285435:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d8379dc00 00000100:00100000:3.0:1789596851.291451:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.292161:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670528 00000100:00100000:2.0:1789596851.292178:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670528 00000100:00100000:2.0:1789596851.292269:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:2.0:1789596851.292282:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+68:11406:x1876527961670528:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789596851.295158:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789596851.295186:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789596851.295274:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789596851.295303:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7e834e89c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789596851.295308:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d83705500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7e834e8b40 00000020:00080000:1.0:1789596851.295311:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d83705400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d836fc800 00000004:00080000:1.0:1789596851.295331:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:2.0:1789596851.295402:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295415:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295423:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295429:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.295433:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295441:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295457:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c7e92a40400) 00010000:00010000:2.0:1789596851.295460:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596851.295466:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295472:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbef78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295520:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295527:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295534:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295539:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.295542:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295549:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295557:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c7e92a40b00) 00010000:00010000:2.0:1789596851.295560:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596851.295563:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295569:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf020 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295584:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295591:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295596:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295608:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.295611:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295618:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295627:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:2.0:1789596851.295629:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596851.295632:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295639:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf09e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295651:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295657:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295663:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295668:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.295671:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295708:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295737:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7e92a40500) 00010000:00010000:2.0:1789596851.295740:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596851.295743:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295749:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf0c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295763:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295769:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295775:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295780:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.295783:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295788:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295796:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.295798:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596851.295801:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295806:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf193 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295836:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295848:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295855:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295859:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dce00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.295862:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295868:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295876:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:2.0:1789596851.295878:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596851.295882:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.295887:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf250 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596851.296111:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789596851.296119:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596851.296138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984812288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789596851.296204:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596851.296248:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984812288 00000100:00100000:0.0:1789596851.296255:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984812288 00000100:00100000:0.0:1789596851.296319:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789596851.296328:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3645:x1876527984812288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789596851.296354:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1789596851.296398:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aab14b2, atime: 0x6aab14b2, ctime: 0x6aab14b2, blocks: 0x8 00010000:00010000:0.0:1789596851.296405:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296420:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1789596851.296424:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596851.296430:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296445:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296463:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296469:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296487:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789596851.296636:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3645:x1876527984812288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (430us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789596851.296644:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1789596851.296668:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596851.296674:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296707:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596851.296710:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296718:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296741:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296749:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbf27a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596851.296770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596851.296772:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596851.296773:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596851.296991:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789596851.297018:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7e92d40e00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789596851.297023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984812288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789596851.297736:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596851.297748:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984812416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789596851.297754:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984812544:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1789596851.297883:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7d8364cf00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789596851.297888:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d836cd600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d8364c3c0 00000020:00080000:1.0:1789596851.297891:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d836cd800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d83eec800 00000020:00080000:0.0:1789596851.298022:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789596851.298068:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789596851.302317:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1789596851.302357:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789596851.302381:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1789596851.302440:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984812416 00000100:00100000:1.0:1789596851.302450:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984812416 00000100:00100000:1.0:1789596851.302512:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789596851.302521:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11406:x1876527961670528:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 10239us (11085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.302521:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984812416:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789596851.302530:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00002000:00080000:1.0:1789596851.302555:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1789596851.302581:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.302601:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.302610:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789596851.302615:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596851.302620:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.302652:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.302699:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 11 pid: 8436 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.302715:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984812672:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596851.302772:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e917829c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789596851.303253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596851.306972:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596851.307021:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984812544 00000100:00100000:0.0:1789596851.307029:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984812544 00000100:00100000:0.0:1789596851.307087:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596851.307096:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1876527984812544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789596851.307273:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789596851.307278:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789596851 00002000:00010000:0.0:1789596851.307280:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789596851.307282:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789596851 -> 1789596851 00002000:00010000:0.0:1789596851.307284:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789596851.307297:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.307354:0:9893:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789596851.307363:0:9893:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789596851.307488:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670656 00000100:00100000:1.0:1789596851.307492:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670656 00000100:00100000:3.0:1789596851.307647:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984812672:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596851.307664:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00010000:00010000:3.0:1789596851.307670:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.307671:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+12:2408:x1876527961670656:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789596851.307825:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1876527984812544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 729us (859us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789596851.307833:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789596851.308063:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d83e7ad80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789596851.308070:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984812544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789596851.309228:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.309331:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961670784 00000100:00100000:1.0:1789596851.309339:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961670784 00010000:00010000:1.0:1789596851.309382:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 13 pid: 8436 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.309412:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:1.0:1789596851.309420:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2409:x1876527961670784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596851.309433:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596851.309439:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 13 pid: 8436 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.309452:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 13 pid: 8436 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.309488:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bbf02e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079df expref: 13 pid: 8436 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.309506:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596851.309511:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596851.309517:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.309526:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.309548:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596851.309588:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+12:2409:x1876527961670784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 169us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.309595:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00010000:00010000:3.0:1789596851.309632:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.309642:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596851.309650:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1789596851.309653:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596851.309655:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:3.0:1789596851.309661:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.309694:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789596851.310038:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961670656:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 2366us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.310045:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1789596851.310742:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984812416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8219us (8429us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789596851.310751:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1789596851.310773:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789596851.310897:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789596851.310903:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1789596851.310923:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d83e7ad80, transno 4294967310 00000100:00100000:2.0:1789596851.310944:0:3644:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c7d83e79500 x1876527984812416/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789596867 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789596851.310956:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d83e79500/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789596851.310961:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984812416:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789596851.311004:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.311014:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596851.311019:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.311028:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.311042:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.311049:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf281 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.311067:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596851.311069:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596851.311071:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596851.314292:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.314382:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961671040 00000100:00100000:3.0:1789596851.314393:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961671040 00000100:00100000:3.0:1789596851.314461:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1789596851.314472:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11406:x1876527961671040:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.314545:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596851.314582:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a79 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.314622:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596851.314627:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596851.314659:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.314673:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.314710:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596851.314848:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004afdba5c reply state 000000009866c89c transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.314862:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.314868:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596851.314871:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596851.314874:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596851.315299:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11406:x1876527961671040:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 826us (1013us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789596851.315308:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:2.0:1789596851.318994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.319093:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961671168 00000100:00100000:1.0:1789596851.319104:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961671168 00000100:00100000:1.0:1789596851.319206:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789596851.319216:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961671168:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789596851.319398:0:9893:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789596851.319425:0:9893:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789596851 -> 1789596851 00002000:00010000:1.0:1789596851.319428:0:9893:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789596850 00002000:00010000:1.0:1789596851.319430:0:9893:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789596851 -> 1789596851 00002000:00010000:1.0:1789596851.319433:0:9893:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789596851.319497:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961671168:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 281us (513us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789596851.319514:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789596851.323249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.323353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961671424 00000100:00100000:1.0:1789596851.323364:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961671424 00000100:00100000:1.0:1789596851.323668:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:1.0:1789596851.323714:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+17:11406:x1876527961671424:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789596851.323791:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.323810:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 17 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.323820:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.326080:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 17 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.326106:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 17 pid: 11184 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.326123:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984812800:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596851.326225:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91782d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596851.329658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.329704:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984812800:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596851.329734:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.330111:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961671552 00000100:00100000:3.0:1789596851.330121:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961671552 00010000:00010000:3.0:1789596851.330156:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 18 pid: 11184 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.330195:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:3.0:1789596851.330205:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+18:2409:x1876527961671552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596851.330220:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596851.330227:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 18 pid: 11184 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.330254:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 18 pid: 11184 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.330277:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf249 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a6b expref: 18 pid: 11184 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.330293:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596851.330297:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.330307:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.330315:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.330345:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596851.330455:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+17:2409:x1876527961671552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 251us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.330462:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00010000:00010000:1.0:1789596851.331022:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331033:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331074:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331082:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331089:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331096:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596851.331113:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331123:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331135:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:1.0:1789596851.331138:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789596851.331142:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.331149:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf28f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.331212:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11406:x1876527961671424:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 7533us (7969us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789596851.331221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:0.0:1789596851.341554:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.341669:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961671680 00000100:00100000:3.0:1789596851.341702:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961671680 00000100:00100000:3.0:1789596851.341758:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789596851.341769:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961671680:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.341810:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.341860:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 7 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.341869:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596851.341874:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596851.341878:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.341919:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 7 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.341933:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 7 pid: 9893 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.341956:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876527984812928:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596851.342033:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596851.348097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.348158:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961671808 00000100:00100000:1.0:1789596851.348170:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961671808 00010000:00010000:1.0:1789596851.348213:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 8 pid: 9893 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.348269:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:1.0:1789596851.348280:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961671808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596851.348295:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596851.348317:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 8 pid: 9893 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.348328:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876527984812928:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596851.348329:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 8 pid: 9893 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.348350:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bbf273 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a87 expref: 8 pid: 9893 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348352:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.348381:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596851.348386:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596851.348391:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.348430:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.348460:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596851.348489:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348497:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.348517:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961671808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 239us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.348524:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00010000:00010000:3.0:1789596851.348532:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348541:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348548:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348556:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596851.348560:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348568:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348580:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.348587:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf296 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.348631:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2409:x1876527961671680:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 6864us (7086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.348639:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789596851.350663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.351969:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961672064 00000100:00100000:3.0:1789596851.351982:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961672064 00000100:00100000:3.0:1789596851.352047:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:3.0:1789596851.352058:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+16:11406:x1876527961672064:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789596851.352133:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.352151:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.352162:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.352194:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.352208:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 16 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.352222:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984813056:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596851.352298:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596851.357021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596851.357193:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984813056:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596851.357221:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.357347:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961672192 00000100:00100000:2.0:1789596851.357355:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961672192 00010000:00010000:2.0:1789596851.357409:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 17 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.357450:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:2.0:1789596851.357462:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+17:2408:x1876527961672192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596851.357498:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596851.357506:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 17 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.357520:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 17 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.358570:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a33 expref: 17 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.358594:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.358601:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.358613:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.358622:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.358631:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.358667:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596851.358745:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+16:2408:x1876527961672192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1285us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596851.358753:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00010000:00010000:3.0:1789596851.359482:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.359492:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.360162:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.360178:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.360187:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.360220:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.360234:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 16 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.360248:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984813184:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596851.360328:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596851.363896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.364247:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961672320 00000100:00100000:2.0:1789596851.364257:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961672320 00010000:00010000:2.0:1789596851.364299:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 17 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.364383:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:2.0:1789596851.364392:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+17:2408:x1876527961672320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596851.364407:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596851.364414:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 17 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.364428:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 17 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.364449:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:2.0:1789596851.364454:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.364464:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.364472:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.364488:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596851.364547:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+17:2408:x1876527961672320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 156us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596851.364555:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00010000:00010000:3.0:1789596851.364727:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf257 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a72 expref: 16 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596851.364756:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984813184:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596851.364787:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.364797:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.364804:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596851.365002:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789596851.366716:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789596851.366822:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789596851.366961:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984813312:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789596851.367049:0:11184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596851.367126:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984813312 00000100:00100000:3.0:1789596851.367137:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984813312 00000100:00100000:3.0:1789596851.367215:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789596851.367226:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11184:x1876527984813312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789596851.368604:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11184:x1876527984813312:12345-0@lo:1000:mdt00_004.0 Request processed in 1370us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596851.368627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789596851.368696:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596851.368745:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984813312:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789596851.368979:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789596851.369072:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984813440:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789596851.369135:0:11184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596851.370312:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789596851.371101:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984813440 00000100:00100000:1.0:1789596851.371119:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984813440 00000100:00100000:1.0:1789596851.371197:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789596851.371209:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11184:x1876527984813440:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789596851.371438:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11184:x1876527984813440:12345-0@lo:1000:mdt00_004.0 Request processed in 231us (2302us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789596851.371447:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789596851.371755:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984813440:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789596851.371810:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371848:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371857:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371863:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.371868:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371875:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371891:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:2.0:1789596851.371895:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596851.371900:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371907:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf2a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371934:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371941:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371947:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371953:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.371962:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371968:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.371979:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.371982:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596851.371992:0:11184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.372017:0:11184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.372030:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.372069:0:11184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.372085:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984813568:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789596851.372169:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596851.379472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.379889:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961672448 00000100:00100000:1.0:1789596851.379900:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961672448 00000100:00100000:1.0:1789596851.379964:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1789596851.379974:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11405:x1876527961672448:12345-192.168.202.16@tcp:49:lfs.0 00000100:00100000:1.0:1789596851.380116:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+20:11405:x1876527961672448:12345-192.168.202.16@tcp:49:lfs.0 Request processed in 142us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.380124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789596851.381180:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984813568:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789596851.381213:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381225:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf1e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381357:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381383:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381395:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381406:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381412:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381419:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381424:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.381428:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381435:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381447:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.381450:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596851.381454:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381460:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf2ab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381480:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381485:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381491:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381496:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596851.381498:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381504:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381513:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.381516:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596851.381519:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.381525:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf29d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.382624:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11406:x1876527961672064:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 30559us (31959us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789596851.382638:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000020:00080000:2.0:1789596851.382644:0:11184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789596851.384498:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789596851.384508:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596851.385095:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789596851.385107:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596851.389780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596851.389925:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961672704 00000100:00100000:0.0:1789596851.389945:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961672704 00000100:00100000:0.0:1789596851.391463:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:0.0:1789596851.391483:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11405:x1876527961672704:12345-192.168.202.16@tcp:58:lfs.0 00000040:00080000:0.0:1789596851.391669:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789596851.391782:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11405:x1876527961672704:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 306us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596851.391790:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:3.0:1789596851.397775:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.398056:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961672960 00000100:00100000:1.0:1789596851.398067:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961672960 00000100:00100000:1.0:1789596851.398128:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789596851.398139:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:11406:x1876527961672960:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789596851.398527:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789596851.398628:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789596851.398666:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.398787:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.398802:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.398812:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.398819:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.398894:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.398911:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789596851.399004:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11406:x1876527961672960:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 865us (1237us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789596851.399014:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000020:00080000:1.0:1789596851.399020:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789596851.399134:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596851.399143:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.399150:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596851.399154:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.399182:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.399195:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596851.399198:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789596851.399203:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.399210:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596851.399222:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596851.399224:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596851.399226:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596851.471231:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.471560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961673088 00000100:00100000:1.0:1789596851.471579:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961673088 00000100:00100000:1.0:1789596851.471656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1789596851.471669:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+21:11409:x1876527961673088:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596851.471737:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596851.471760:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a8e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472047:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472064:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472076:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472092:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472100:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472108:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472241:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472447:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472459:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472503:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.472519:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 22 pid: 6520 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596851.472542:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984813696:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596851.473048:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91782d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596851.484192:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596851.484326:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984813696:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596851.484353:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596851.484493:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961673344 00000100:00100000:0.0:1789596851.484500:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961673344 00000100:00100000:0.0:1789596851.484560:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789596851.484578:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+23:6177:x1876527961673344:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789596851.485038:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:6177:x1876527961673344:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 467us (853us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789596851.485047:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1789596851.488441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596851.488617:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961673472 00000100:00100000:2.0:1789596851.488629:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961673472 00010000:00010000:2.0:1789596851.488671:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 24 pid: 6520 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596851.488983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:2.0:1789596851.488994:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+24:2408:x1876527961673472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596851.489011:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596851.489018:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 24 pid: 6520 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.489032:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 24 pid: 6520 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.489054:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf1d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a4f expref: 24 pid: 6520 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.489071:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596851.489076:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.489087:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.489095:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596851.489129:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596851.489187:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+23:2408:x1876527961673472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 194us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596851.489211:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00010000:00010000:1.0:1789596851.489290:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489298:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596851.489345:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789596851.489349:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596851.489377:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489391:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489401:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489421:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489427:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489433:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596851.489438:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489446:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489456:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:1.0:1789596851.489459:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596851.489463:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489470:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf2c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489482:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489488:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489494:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489499:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596851.489509:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489516:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489524:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c7eb9a7ff00) 00010000:00010000:1.0:1789596851.489526:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596851.489529:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489535:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf2c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf2b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a8e expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489599:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a8e expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596851.489606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:1.0:1789596851.489608:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596851.489611:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1600, rc 0) 00000100:00100000:1.0:1789596851.489639:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11409:x1876527961673088:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 17974us (18418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596851.489646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00010000:00010000:0.0:1789596851.649936:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596852.420789:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596852.420801:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596852.420829:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789596852.420836:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596852.420979:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984813824:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596852.421070:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83ddad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596852.433729:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596852.433826:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984813824:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596852.437723:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961673600 00000100:00100000:3.0:1789596852.437738:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961673600 00000100:00100000:3.0:1789596852.437802:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:3.0:1789596852.437813:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11420:x1876527961673600:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596852.437848:0:11184:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596852.437975:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11420:x1876527961673600:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 163us (4254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596852.437983:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:1.0:1789596852.444941:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596852.445139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961673856 00000100:00100000:2.0:1789596852.445152:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961673856 00000100:00100000:2.0:1789596852.445207:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:2.0:1789596852.445218:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:11420:x1876527961673856:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596852.445240:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596852.445262:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.445381:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.445397:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.445411:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596852.445423:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789596852.445532:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a95 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.445551:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a95 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.445560:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596852.445564:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596852.445568:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd600, rc 0) 00000100:00100000:2.0:1789596852.445641:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11420:x1876527961673856:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 424us (709us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789596852.445648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:0.0:1789596852.455994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596852.456037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596852.456135:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961674112 00000100:00100000:1.0:1789596852.456147:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961674112 00000100:00100000:1.0:1789596852.456218:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:1.0:1789596852.456228:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11420:x1876527961674112:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789596852.456312:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456331:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456343:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456529:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456538:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456545:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456551:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596852.456555:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456563:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456574:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:1.0:1789596852.456577:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596852.456582:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596852.456598:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1200/0x7b5398e289bbf2ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596852.456751:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+25:11420:x1876527961674112:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 524us (765us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789596852.456759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000040:00080000:1.0:1789596852.456863:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789596852.456867:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596852.457405:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789596852.457417:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596852.458163:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961674240 00000100:00100000:2.0:1789596852.458174:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961674240 00000100:00100000:2.0:1789596852.458236:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789596852.458246:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+25:2407:x1876527961674240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596852.458261:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596852.458286:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a95 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.458305:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596852.458310:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596852.458353:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+24:2407:x1876527961674240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 110us (2317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596852.458371:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789596852.463448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596852.463528:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961674496 00000100:00100000:1.0:1789596852.463539:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961674496 00000100:00100000:1.0:1789596852.463600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:1.0:1789596852.463611:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:11420:x1876527961674496:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789596852.463885:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+25:11420:x1876527961674496:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 275us (452us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789596852.463893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000040:00080000:0.0:1789596852.489457:0:14265:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596852.489468:0:14265:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596852.489506:0:14265:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789596852.489512:0:14265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789596852.669075:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596852.702460:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596852.710251:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961674752 00000100:00100000:2.0:1789596852.710267:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961674752 00000100:00100000:2.0:1789596852.710332:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:2.0:1789596852.710342:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+25:11433:x1876527961674752:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596852.710378:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596852.710400:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07a9c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.710511:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.710542:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.710555:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596852.710569:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789596852.710714:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf2f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a9c expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.710735:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a9c expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.710744:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596852.710748:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789596852.710752:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dcc00, rc 0) 00000100:00100000:2.0:1789596852.710830:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+27:11433:x1876527961674752:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 488us (8379us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789596852.710838:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:3.0:1789596852.716291:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596852.716418:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961674880 00000100:00100000:2.0:1789596852.716428:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961674880 00000100:00100000:2.0:1789596852.716484:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:2.0:1789596852.716493:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+27:11433:x1876527961674880:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789596852.716562:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716581:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716609:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716643:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716651:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716669:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716675:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596852.716706:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716715:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716727:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:2.0:1789596852.716730:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596852.716735:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596852.716742:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf306 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596852.716823:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+27:11433:x1876527961674880:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 321us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596852.716831:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:0.0:1789596852.830903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596852.831386:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675008 00000100:00100000:3.0:1789596852.831411:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675008 00000100:00100000:3.0:1789596852.831478:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789596852.831489:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961675008:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:3.0:1789596852.831506:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596852.831528:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf30d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07aa3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596852.831554:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aab14b3, atime: 0x6aab14b2, ctime: 0x6aab14b3, blocks: 0x8 00010000:00010000:3.0:1789596852.831575:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789596852.831580:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596852.831589:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf30d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07aa3 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596852.831608:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf30d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07aa3 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596852.831622:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671000, rc 0) 00000100:00100000:3.0:1789596852.831723:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961675008:12345-192.168.202.16@tcp:101:cat.0 Request processed in 235us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596852.831730:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:0.0:1789596852.839918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596852.840035:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675136 00000100:00100000:2.0:1789596852.840060:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675136 00002000:00100000:2.0:1789596852.840112:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9c7d825f7800 x1876527961675136/t0(0) o3->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:733/0 lens 488/0 e 0 to 0 dl 1789596863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596852.840125:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d825f7800 with x1876527961675136 ext(0->4095) 00002000:00010000:2.0:1789596852.840131:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d825f7800 00000100:00100000:2.0:1789596852.840168:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789596852.840190:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2407:x1876527961675136:12345-192.168.202.16@tcp:3:cat.0 00000100:00100000:2.0:1789596852.840375:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2407:x1876527961675136:12345-192.168.202.16@tcp:3:cat.0 Request processed in 196us (466us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789596852.840382:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00100000:2.0:1789596852.840389:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9c7d825f7800 x1876527961675136/t0(0) o3->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:733/0 lens 488/4536 e 0 to 0 dl 1789596863 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596852.840398:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d825f7800 with x1876527961675136 ext(0->4095) 00002000:00010000:2.0:1789596852.840402:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d825f7800 00000100:00100000:3.0:1789596853.181315:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596853.181341:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984813952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596853.181495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596853.181704:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984813952 00000100:00100000:1.0:1789596853.181714:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984813952 00000100:00100000:1.0:1789596853.181774:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789596853.181785:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984813952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596853.181835:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789596853.181900:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984813952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596853.181907:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789596853.182206:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984813952:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789596853.692868:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596854.207045:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984814080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596854.207117:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596854.207195:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814080 00000100:00100000:2.0:1789596854.207205:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814080 00000100:00100000:2.0:1789596854.207260:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789596854.207271:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876527984814080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596854.207302:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789596854.207359:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876527984814080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596854.207378:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789596854.207399:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596854.207435:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984814080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596854.209441:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596854.209469:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984814208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596854.209533:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596854.209642:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814208 00000100:00100000:0.0:1789596854.209649:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814208 00000100:00100000:0.0:1789596854.209745:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789596854.209755:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984814208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596854.209777:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:3.0:1789596854.209911:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596854.210221:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984814208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 467us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596854.210229:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789596854.210303:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984814208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596854.717048:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984814336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596854.717140:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596854.717336:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596854.717903:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814336 00000100:00100000:2.0:1789596854.717914:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814336 00000100:00100000:2.0:1789596854.717989:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789596854.717999:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984814336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789596854.718031:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596854.718083:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984814336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596854.718089:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1789596854.718150:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596854.722436:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984814720:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.722516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.722570:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984815232:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.722596:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.722640:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789596854.722648:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984814592:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.722719:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.722744:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984815104:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.722766:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.722783:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984815616:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.722803:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.722834:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815232 00000100:00100000:3.0:1789596854.722842:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815232 00000100:00100000:3.0:1789596854.722894:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814592 00000100:00100000:3.0:1789596854.722897:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814592 00000100:00100000:3.0:1789596854.722914:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815104 00000100:00100000:3.0:1789596854.722916:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815104 00000100:00100000:3.0:1789596854.722933:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789596854.722941:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984815232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.722994:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984815232:12345-0@lo:400:kworker.0 Request processed in 53us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723001:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789596854.723018:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789596854.723024:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984814592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723060:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984814592:12345-0@lo:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723066:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789596854.723079:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789596854.723085:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984815104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723108:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984815104:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789596854.723149:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984814592:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984815104:0@lo:400:kworker.0 00010000:00080000:3.0:1789596854.723168:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442ca80 x1876527984815232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596854.723178:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984815232:0@lo:400:kworker.0 00000100:00080000:3.0:1789596854.723202:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596854.723206:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596854.723216:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984814848:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723240:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.723258:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984815360:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723275:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.723304:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984814336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596854.723321:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789596854.723327:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984814464:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723367:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.723396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984814976:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723417:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.723433:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984815488:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723450:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.723466:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814848 00000100:00100000:3.0:1789596854.723469:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814848 00000100:00100000:3.0:1789596854.723485:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815360 00000100:00100000:3.0:1789596854.723487:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815360 00000100:00100000:3.0:1789596854.723504:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815488 00000100:00100000:3.0:1789596854.723506:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815488 00000100:00100000:3.0:1789596854.723518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789596854.723523:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984814848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723553:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984814848:12345-0@lo:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723557:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789596854.723568:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789596854.723573:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984815360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723598:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984815360:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723603:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789596854.723614:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789596854.723619:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984815488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723645:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984815488:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723650:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789596854.723668:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814720 00000100:00100000:3.0:1789596854.723671:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814720 00000100:00100000:3.0:1789596854.723719:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814976 00000100:00100000:3.0:1789596854.723722:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814976 00000100:00100000:3.0:1789596854.723734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789596854.723740:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984814720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723776:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984814720:12345-0@lo:400:kworker.0 Request processed in 37us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789596854.723791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789596854.723797:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984814976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723820:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984814976:12345-0@lo:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.723825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789596854.723847:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984814720:0@lo:400:kworker.0 00000100:00080000:3.0:1789596854.723861:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596854.723864:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596854.723875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984814976:0@lo:400:kworker.0 00010000:00080000:3.0:1789596854.723886:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442df80 x1876527984815488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596854.723896:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984815488:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723904:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984814848:0@lo:400:kworker.0 00000100:00100000:3.0:1789596854.723913:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984815360:0@lo:400:kworker.0 00000100:00100000:1.0:1789596854.725033:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815616 00000100:00100000:1.0:1789596854.725044:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815616 00000100:00100000:1.0:1789596854.725108:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596854.725117:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984815616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596854.725196:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984815616:12345-0@lo:400:kworker.0 Request processed in 81us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596854.725203:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596854.725224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984814464 00000100:00100000:1.0:1789596854.725228:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984814464 00000100:00100000:1.0:1789596854.725253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789596854.725270:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984814464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596854.725306:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984814464:12345-0@lo:400:kworker.0 Request processed in 48us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596854.725312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789596854.725376:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789596854.725383:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1789596854.725402:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7e85f09c00, transno 4294967302 00000004:00080000:1.0:1789596854.725413:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789596854.725424:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7e92d40e00, transno 4294967305 00000100:00100000:1.0:1789596854.725431:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984815616:0@lo:400:kworker.0 00000100:00100000:1.0:1789596854.725575:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984814464:0@lo:400:kworker.0 00000100:00080000:3.0:1789596854.727575:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596854.729809:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596854.729844:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984815744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596854.729939:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596854.731290:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815744 00000100:00100000:3.0:1789596854.731303:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815744 00000100:00100000:3.0:1789596854.731382:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789596854.731407:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984815744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596854.731436:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596854.731526:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984815744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596854.731533:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789596854.731737:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984815744:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789596855.556229:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596855.556242:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596855.556286:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789596855.556295:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789596855.743579:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596855.816537:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789596856.253319:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596856.255613:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984815872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596856.255753:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596856.256152:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984815872 00000100:00100000:3.0:1789596856.256166:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984815872 00000100:00100000:3.0:1789596856.256239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789596856.256250:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984815872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596856.256297:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596856.262310:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984815872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6046us (6542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596856.262344:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789596856.263352:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984815872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596856.325539:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325662:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325761:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596856.325817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675520 00000100:00100000:2.0:1789596856.325831:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675520 00000100:00100000:2.0:1789596856.325920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676032 00000100:00100000:2.0:1789596856.325923:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676032 00000100:00100000:2.0:1789596856.325938:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675392 00000100:00100000:2.0:1789596856.325941:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675392 00000100:00100000:2.0:1789596856.325955:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675904 00000100:00100000:2.0:1789596856.325958:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675904 00000100:00100000:2.0:1789596856.325978:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 327 00000100:00100000:2.0:1789596856.325990:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961675520:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596856.326279:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961675520:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 289us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596856.326289:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 327 00000100:00100000:2.0:1789596856.326312:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 328 00000100:00100000:2.0:1789596856.326319:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961676032:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596856.326358:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961676032:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596856.326364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 328 00000100:00100000:2.0:1789596856.326375:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 329 00000100:00100000:2.0:1789596856.326382:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:2409:x1876527961675392:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596856.326406:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:2409:x1876527961675392:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596856.326412:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 329 00000100:00100000:2.0:1789596856.326423:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 330 00000100:00100000:2.0:1789596856.326429:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961675904:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596856.326460:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2409:x1876527961675904:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596856.326465:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 330 00000100:00100000:2.0:1789596856.326489:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675776 00000100:00100000:2.0:1789596856.326493:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675776 00000100:00100000:2.0:1789596856.326584:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675648 00000100:00100000:2.0:1789596856.326588:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675648 00000100:00100000:2.0:1789596856.326623:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:2.0:1789596856.326630:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961675776:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596856.326658:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2409:x1876527961675776:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596856.326664:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:2.0:1789596856.326674:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:2.0:1789596856.326706:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961675648:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596856.326729:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961675648:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596856.326735:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00080000:2.0:1789596856.326769:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596856.326773:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596856.326776:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596856.326778:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596856.329202:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961675264 00000100:00100000:0.0:1789596856.329225:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961675264 00000100:00100000:0.0:1789596856.329340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 391 00000100:00100000:0.0:1789596856.329354:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961675264:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596856.329456:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961675264:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 106us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596856.329465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 391 00010000:00010000:3.0:1789596856.765875:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789596857.291577:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789596857.291640:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7eb9af4300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789596857.291646:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7eb66b6700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7e881186c0 00000020:00080000:2.0:1789596857.291650:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7eb66b6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7e8698f600 00000020:00080000:2.0:1789596857.291729:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789596857.291760:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789596857.291903:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789596857.297363:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596857.297386:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596857.297397:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596857.297404:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596857.297409:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596857.297418:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596857.297467:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c7d82471600) 00010000:00010000:3.0:1789596857.297470:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596857.297476:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596857.297483:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf288 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596857.303169:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789596857.303195:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1789596857.788994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596858.304033:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984816000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596858.304142:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596858.304855:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816000 00000100:00100000:2.0:1789596858.304868:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816000 00000100:00100000:2.0:1789596858.304946:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789596858.304971:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984816000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789596858.305027:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789596858.312709:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984816000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7703us (8529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596858.312737:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789596858.316022:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984816000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596858.468051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596858.468605:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676160 00000100:00100000:3.0:1789596858.468621:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676160 00000100:00100000:3.0:1789596858.468732:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1789596858.468746:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+13:11094:x1876527961676160:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789596858.468889:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+13:11094:x1876527961676160:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 146us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596858.468897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00080000:2.0:1789596858.469435:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596858.476034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596858.476140:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676288 00000100:00100000:2.0:1789596858.476153:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676288 00000100:00100000:2.0:1789596858.476246:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:2.0:1789596858.476258:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:11094:x1876527961676288:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789596858.476411:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:11094:x1876527961676288:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 155us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596858.476421:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00080000:3.0:1789596858.476489:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596858.495617:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596858.495751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676544 00000100:00100000:1.0:1789596858.495765:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676544 00000100:00100000:1.0:1789596858.495848:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789596858.495861:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:11094:x1876527961676544:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789596858.496505:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+14:11094:x1876527961676544:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 642us (897us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789596858.496516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00010000:00010000:3.0:1789596858.813060:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596859.325279:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596859.325322:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984816128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596859.325422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596859.325527:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816128 00000100:00100000:1.0:1789596859.325537:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816128 00000100:00100000:1.0:1789596859.325605:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789596859.325617:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984816128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596859.325654:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789596859.325726:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984816128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596859.325734:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789596859.325803:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789596859.325810:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d83e79500, transno 4294967311 00000004:00080000:1.0:1789596859.325822:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1789596859.325861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984816128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596859.327242:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596859.327708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984816256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596859.327965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596859.332612:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816256 00000100:00100000:2.0:1789596859.332641:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816256 00000100:00080000:3.0:1789596859.333157:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596859.333638:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789596859.333658:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984816256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596859.333727:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789596859.333863:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984816256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596859.333893:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789596859.334012:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984816256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596859.837080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984816640:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.837254:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984817152:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.837345:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984817664:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837371:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.837401:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789596859.837406:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984816768:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.837445:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984817280:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837464:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.837502:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816640 00000100:00100000:0.0:1789596859.837513:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816640 00000100:00100000:0.0:1789596859.837580:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789596859.837593:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984816640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837701:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984816640:12345-0@lo:400:kworker.0 Request processed in 86us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.837710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789596859.837743:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817152 00000100:00100000:0.0:1789596859.837747:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817152 00000100:00100000:0.0:1789596859.837788:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816768 00000100:00100000:0.0:1789596859.837791:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816768 00000100:00100000:0.0:1789596859.837811:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817280 00000100:00100000:0.0:1789596859.837814:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817280 00000100:00100000:0.0:1789596859.837831:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789596859.837837:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984817152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837870:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984817152:12345-0@lo:400:kworker.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.837877:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789596859.837890:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789596859.837905:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984816768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837936:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984816768:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.837942:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789596859.837954:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789596859.837959:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984817280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.837985:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984817280:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.837990:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789596859.838009:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817664 00000100:00100000:0.0:1789596859.838013:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817664 00000100:00100000:0.0:1789596859.838044:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789596859.838051:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984817664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.838080:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984817664:12345-0@lo:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.838086:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789596859.838113:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596859.838119:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596859.838121:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596859.838164:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984816768:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.838175:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984817280:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.838184:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984816640:0@lo:400:kworker.0 00010000:00080000:0.0:1789596859.838196:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442d880 x1876527984817152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596859.838208:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984817152:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.838229:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984817664:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.838718:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984816384:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.838772:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596859.838852:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984816896:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.838882:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596859.838900:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984817408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.838924:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596859.838944:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789596859.838950:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984816512:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.838972:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596859.838988:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984817024:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.839010:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596859.839024:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984817536:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.839044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.839361:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817408 00000100:00100000:0.0:1789596859.839369:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817408 00000100:00100000:0.0:1789596859.839414:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816512 00000100:00100000:0.0:1789596859.839418:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816512 00000100:00100000:0.0:1789596859.839436:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817024 00000100:00100000:0.0:1789596859.839439:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817024 00000100:00100000:0.0:1789596859.839456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789596859.839464:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.839519:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984817408:12345-0@lo:400:kworker.0 Request processed in 56us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.839526:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789596859.839542:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789596859.839547:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.839576:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984816512:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.839581:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789596859.839591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789596859.839597:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984817024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.840778:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984817024:12345-0@lo:400:kworker.0 Request processed in 1170us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.840791:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789596859.841018:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817536 00000100:00100000:2.0:1789596859.841030:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817536 00000100:00100000:0.0:1789596859.841191:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984817792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596859.841280:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789596859.841300:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984817536:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1789596859.842727:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1789596859.845525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442f480 x1876527984817408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596859.845552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984817408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.845588:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984816512:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.845602:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984817024:0@lo:400:kworker.0 00000100:00100000:0.0:1789596859.845801:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596859.845905:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817792 00000100:00100000:0.0:1789596859.845915:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817792 00000100:00100000:2.0:1789596859.853056:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984817536:12345-0@lo:400:kworker.0 Request processed in 11750us (13993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596859.854459:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596859.854491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984817920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596859.854583:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789596859.854672:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596859.854710:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596859.854714:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596859.854737:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816896 00000100:00100000:3.0:1789596859.854749:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816896 00000100:00100000:3.0:1789596859.854812:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789596859.855075:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789596859.855413:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984816896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596859.855506:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984816896:12345-0@lo:400:kworker.0 Request processed in 173us (16621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596859.855513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789596859.855545:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984816384 00000100:00100000:2.0:1789596859.855551:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984816384 00000100:00100000:2.0:1789596859.855585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789596859.855592:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984816384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596859.855640:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984816384:12345-0@lo:400:kworker.0 Request processed in 49us (16868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596859.855645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789596859.855912:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984817920 00000100:00100000:0.0:1789596859.855917:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984817920 00000100:00100000:0.0:1789596859.855940:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596859.855947:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984817792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596859.855977:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596859.856026:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984817792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (10225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.856031:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596859.856102:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984817792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596859.856135:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789596859.856142:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984817920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596859.856152:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596859.856184:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984817920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596859.856190:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789596859.856217:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984817920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596859.857171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984817536:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.857187:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984816384:0@lo:400:kworker.0 00000100:00100000:1.0:1789596859.857197:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984816896:0@lo:400:kworker.0 00000001:02000400:1.0:1789596860.851440:0:14462:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:14:19 (1789596859) 00010000:00010000:3.0:1789596860.860926:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596861.375325:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984818048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596861.375514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596861.375962:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818048 00000100:00100000:3.0:1789596861.375975:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818048 00000100:00100000:3.0:1789596861.376203:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789596861.376218:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984818048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789596861.376273:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789596861.376918:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984818048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 697us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596861.376929:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789596861.377597:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984818048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596861.433663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596861.433768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596861.433924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676672 00000100:00100000:1.0:1789596861.433941:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676672 00000100:00100000:1.0:1789596861.434033:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 393 00000100:00100000:1.0:1789596861.434047:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961676672:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596861.434169:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961676672:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596861.434177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 393 00000100:00100000:0.0:1789596861.434854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596861.434911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596861.434932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596861.434952:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596861.434979:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596861.435004:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676928 00000100:00100000:3.0:1789596861.435177:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677440 00000100:00100000:3.0:1789596861.435185:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677440 00000100:00100000:3.0:1789596861.435254:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961676800 00000100:00100000:3.0:1789596861.435257:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676800 00000100:00100000:3.0:1789596861.435273:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677312 00000100:00100000:3.0:1789596861.435287:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677312 00000100:00100000:3.0:1789596861.435307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 337 00000100:00100000:3.0:1789596861.435315:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961677440:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596861.435562:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961677440:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 246us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596861.435570:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 337 00000100:00100000:3.0:1789596861.435589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 338 00000100:00100000:3.0:1789596861.435596:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+14:2406:x1876527961676800:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596861.435631:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+14:2406:x1876527961676800:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 35us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596861.435637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 338 00000100:00100000:3.0:1789596861.435648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 339 00000100:00100000:3.0:1789596861.435654:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961677312:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596861.435709:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961677312:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596861.435714:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 339 00000100:00080000:3.0:1789596861.435735:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596861.435740:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596861.436206:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961676928 00000100:00100000:0.0:1789596861.436261:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 340 00000100:00100000:0.0:1789596861.436269:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961676928:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596861.436320:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961676928:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 52us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596861.436327:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 340 00000100:00080000:2.0:1789596861.436601:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596861.436627:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677184 00000100:00100000:2.0:1789596861.436633:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677184 00000100:00100000:2.0:1789596861.436697:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677056 00000100:00100000:2.0:1789596861.436702:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677056 00000100:00100000:2.0:1789596861.436729:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:2.0:1789596861.436737:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961677184:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596861.436780:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961677184:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596861.436787:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:2.0:1789596861.436807:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:2.0:1789596861.436814:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961677056:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596861.436839:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961677056:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596861.436845:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00080000:2.0:1789596861.436860:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596861.436863:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789596861.885006:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596862.833911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596862.835519:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677696 00000100:00100000:2.0:1789596862.835539:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677696 00000100:00100000:2.0:1789596862.835631:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:2.0:1789596862.835643:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+14:12151:x1876527961677696:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596862.835672:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596862.835755:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf314 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07aaa expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.835854:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.835871:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.835888:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.835913:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.835938:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.835945:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836066:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf329 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836074:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf329 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836081:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf329 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596862.836091:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789596862.836197:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836205:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836212:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836218:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596862.836222:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836232:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836256:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7e993a8c00) 00010000:00010000:2.0:1789596862.836260:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596862.836276:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836283:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf31b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836300:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836306:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836313:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836318:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596862.836321:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836326:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836333:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7e84ffe900) 00010000:00010000:2.0:1789596862.836335:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596862.836338:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.836344:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf322 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.837044:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf314 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07aaa expref: 17 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.837069:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf329 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07aaa expref: 16 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.837078:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:2.0:1789596862.837080:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596862.837085:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc200, rc 0) 00000100:00100000:2.0:1789596862.837199:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+16:12151:x1876527961677696:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1556us (3297us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789596862.837209:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:0.0:1789596862.844513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596862.844723:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677824 00000100:00100000:2.0:1789596862.844737:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677824 00000100:00100000:2.0:1789596862.844820:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:2.0:1789596862.844833:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+16:12151:x1876527961677824:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789596862.845008:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+16:12151:x1876527961677824:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 178us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596862.845016:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000001:00080000:0.0:1789596862.846406:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789596862.846429:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789596862.846505:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789596862.846525:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789596862.848607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596862.848760:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961677952 00000100:00100000:2.0:1789596862.848771:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961677952 00000100:00100000:2.0:1789596862.849220:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789596862.849233:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+14:2407:x1876527961677952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596862.849279:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596862.849421:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf329 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07aaa expref: 14 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596862.849445:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:2.0:1789596862.849451:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596862.849556:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2407:x1876527961677952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 325us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596862.849562:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1789596862.852194:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596862.853604:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961678080 00000100:00100000:2.0:1789596862.853617:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961678080 00000100:00100000:2.0:1789596862.853737:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:2.0:1789596862.853748:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:12151:x1876527961678080:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789596862.853888:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:12151:x1876527961678080:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 142us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596862.853895:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00010000:00010000:3.0:1789596862.912146:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596862.974574:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789596863.431733:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984818176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596863.431852:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596863.432016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818176 00000100:00100000:3.0:1789596863.432028:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818176 00000100:00100000:3.0:1789596863.432124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789596863.432136:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984818176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596863.432179:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789596863.448623:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984818176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 16472us (16754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596863.448656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789596863.451546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984818176:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789596863.740896:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596863.740908:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596863.741833:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789596863.741850:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789596863.933664:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596864.444934:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596864.446622:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d82799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984818304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596864.446730:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.446873:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818304 00000100:00100000:0.0:1789596864.446884:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818304 00000100:00100000:0.0:1789596864.446957:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596864.446968:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984818304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596864.447010:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789596864.447065:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984818304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.447073:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1789596864.447118:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596864.447316:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d82799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984818304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596864.447934:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596864.448013:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984818432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596864.448063:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596864.448422:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818432 00000100:00100000:2.0:1789596864.448430:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818432 00000100:00100000:2.0:1789596864.448558:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789596864.448569:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984818432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596864.448591:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789596864.448644:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984818432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596864.448659:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789596864.448713:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596864.448748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984818432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596864.957379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596864.957491:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.957569:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984818688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596864.957573:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818560 00000100:00100000:3.0:1789596864.957584:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818560 00000100:00100000:0.0:1789596864.957594:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.957643:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818688 00000100:00100000:0.0:1789596864.957646:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818688 00000100:00100000:3.0:1789596864.957665:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789596864.957675:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984818560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596864.957751:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596864.957805:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984818560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.961074:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789596864.961111:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984818688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596864.961165:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596864.961283:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984818688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.961292:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789596864.961340:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596864.961368:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984818944:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961418:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.961460:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984819456:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961483:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.961532:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789596864.961540:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961572:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.961595:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984819328:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961621:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.961639:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984819840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961700:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.961732:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818944 00000100:00100000:0.0:1789596864.961743:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818944 00000100:00100000:0.0:1789596864.961785:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819456 00000100:00100000:0.0:1789596864.961788:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819456 00000100:00100000:0.0:1789596864.961814:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819840 00000100:00100000:0.0:1789596864.961817:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819840 00000100:00100000:0.0:1789596864.961834:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789596864.961840:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961880:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984818944:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.961887:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789596864.961901:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789596864.961906:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984819456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961942:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984819456:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.961947:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789596864.961957:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789596864.961963:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984819840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.961985:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984819840:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.961990:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789596864.962007:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984818816 00000100:00100000:0.0:1789596864.962010:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984818816 00000100:00100000:0.0:1789596864.962035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789596864.962040:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962067:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb027a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984818816:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.962078:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789596864.962106:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819328 00000100:00100000:0.0:1789596864.962109:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819328 00000100:00100000:0.0:1789596864.962143:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789596864.962150:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962180:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984819328:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.962185:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1789596864.962212:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596864.962215:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596864.962230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984819200:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.962285:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984819712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962306:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.962353:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596864.962369:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984818688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596864.962404:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789596864.962411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984819072:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962430:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.962445:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984819584:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962463:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596864.962483:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819200 00000100:00100000:0.0:1789596864.962486:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819200 00000100:00100000:0.0:1789596864.962506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819712 00000100:00100000:0.0:1789596864.962508:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819712 00000100:00100000:0.0:1789596864.962534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819584 00000100:00100000:0.0:1789596864.962536:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819584 00000100:00100000:0.0:1789596864.962547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789596864.962552:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984819200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962583:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984819200:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.962588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789596864.962598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789596864.962603:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962625:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984819712:12345-0@lo:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.962631:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789596864.962640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789596864.962645:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984819584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962669:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984819584:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.962675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:0.0:1789596864.962716:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596864.962719:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596864.962725:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984819072 00000100:00100000:0.0:1789596864.962728:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984819072 00000100:00100000:0.0:1789596864.962744:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789596864.962749:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984819072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962777:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984819072:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596864.962783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789596864.962810:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962829:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984819328:0@lo:400:kworker.0 00010000:00080000:0.0:1789596864.962842:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e97b80 x1876527984819840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596864.962853:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984819840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984818944:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962871:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984819456:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962901:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984819072:0@lo:400:kworker.0 00010000:00080000:0.0:1789596864.962910:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e95880 x1876527984819584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596864.962918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984819584:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984819200:0@lo:400:kworker.0 00000100:00100000:0.0:1789596864.962935:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984819712:0@lo:400:kworker.0 00000100:00100000:3.0:1789596864.963395:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00010000:0.0:1789596864.968237:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596865.022339:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789596865.362820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.363092:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961678208 00000100:00100000:0.0:1789596865.363108:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961678208 00000100:00080000:2.0:1789596865.363293:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596865.363452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:0.0:1789596865.363467:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:12193:x1876527961678208:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596865.363497:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596865.363527:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ab1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363616:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363644:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363663:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363717:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363726:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363733:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363966:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363977:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363985:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.363992:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596865.363999:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364008:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364023:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:0.0:1789596865.364033:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596865.364041:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364048:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf33e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364064:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364070:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364077:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364082:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596865.364085:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364091:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364099:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7d833d8500) 00010000:00010000:0.0:1789596865.364102:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596865.364105:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364112:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364148:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf337 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ab1 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364190:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:0.0:1789596865.364193:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596865.364198:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ab1 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.364209:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742800, rc 0) 00000100:00100000:0.0:1789596865.364342:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:12193:x1876527961678208:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 879us (1536us total) trans 0 rc 301/301 00000100:00100000:0.0:1789596865.364351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:3.0:1789596865.386179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596865.386289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961678464 00000100:00100000:1.0:1789596865.386302:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961678464 00000100:00100000:1.0:1789596865.386379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:1.0:1789596865.386391:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+13:12193:x1876527961678464:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:1.0:1789596865.386464:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596865.386498:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb64c6800/0x7b5398e289bbec99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078dc expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.386523:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a92100) 00010000:00010000:1.0:1789596865.386540:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596865.386637:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.386654:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.386667:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.386737:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.386746:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.386753:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387428:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387440:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387448:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596865.387464:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b05e31c reply state 00000000c0f45045 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387476:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387483:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596865.387485:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789596865.387488:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789596865.387494:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789596865.387503:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387510:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387525:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387532:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596865.387537:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387546:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387556:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a7f000) 00010000:00010000:1.0:1789596865.387559:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596865.387563:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387570:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf34c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596865.387588:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b05e31c reply state 00000000c0f45045 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387597:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.387603:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7eb9a7f900) 00010000:00010000:1.0:1789596865.387605:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789596865.387607:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789596865.387749:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+14:12193:x1876527961678464:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 1356us (1592us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789596865.387759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:3.0:1789596865.457493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.457642:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961678592 00000100:00100000:2.0:1789596865.457657:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961678592 00000100:00100000:2.0:1789596865.457763:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:2.0:1789596865.457777:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+14:12201:x1876527961678592:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:2.0:1789596865.457814:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.457849:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf361 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ab8 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.457937:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf368 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.457955:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.457969:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596865.458034:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789596865.458038:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596865.458067:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.458099:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ab8 expref: 16 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.458120:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf368 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ab8 expref: 15 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.458148:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:2.0:1789596865.458152:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596865.458156:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd800, rc 0) 00000100:00100000:2.0:1789596865.458259:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+15:12201:x1876527961678592:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 484us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.458267:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:3.0:1789596865.524931:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.525102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961678720 00000100:00100000:0.0:1789596865.525114:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961678720 00000100:00100000:0.0:1789596865.525187:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:0.0:1789596865.525199:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+15:12207:x1876527961678720:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789596865.525230:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596865.525272:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf36f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07abf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.525637:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.525655:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.525670:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.525937:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.525949:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.525957:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526117:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526126:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526134:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596865.526180:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789596865.526185:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596865.526210:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526224:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526954:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526963:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526970:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596865.526975:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.526984:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527000:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:2.0:1789596865.527004:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596865.527011:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527018:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527037:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527042:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527048:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527054:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596865.527063:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527070:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527077:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7eb9a7f900) 00010000:00010000:2.0:1789596865.527079:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596865.527081:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527087:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf37d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527124:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf36f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07abf expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527139:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07abf expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.527146:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596865.527149:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789596865.527151:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd600, rc 0) 00000100:00100000:2.0:1789596865.527256:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+16:12207:x1876527961678720:12345-192.168.202.16@tcp:101:bash.0 Request processed in 2056us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.527265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:2.0:1789596865.534856:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596865.535103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961678976 00000100:00100000:1.0:1789596865.535118:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961678976 00000100:00100000:1.0:1789596865.535295:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:1.0:1789596865.535308:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+16:12207:x1876527961678976:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789596865.535342:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596865.535373:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf38b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ac6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.535527:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.535546:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.535559:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.535574:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.535581:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.535587:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596865.536110:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789596865.536284:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536296:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536325:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536370:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536378:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536385:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536392:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596865.536396:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536405:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596865.536423:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596865.536429:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536435:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf392 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596865.536450:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047ce3af3 reply state 00000000ec1d405b transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536462:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536475:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:1.0:1789596865.536478:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789596865.536481:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789596865.536517:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf38b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536531:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.536538:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:1.0:1789596865.536540:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596865.536542:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0400, rc 0) 00000100:00100000:1.0:1789596865.536635:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:12207:x1876527961678976:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1330us (1797us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789596865.536644:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:3.0:1789596865.540166:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.540354:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961679104 00000100:00100000:2.0:1789596865.540369:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961679104 00000100:00100000:2.0:1789596865.540474:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:2.0:1789596865.540505:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961679104:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596865.540530:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.540560:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07acd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596865.540593:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789596865.540621:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789596865.540626:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596865.540638:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.540660:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.540712:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc000, rc 0) 00000100:00100000:2.0:1789596865.540992:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2406:x1876527961679104:12345-192.168.202.16@tcp:101:bash.0 Request processed in 488us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.541001:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00080000:0.0:1789596865.541931:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596865.546373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.546533:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961679232 00000100:00100000:2.0:1789596865.546548:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961679232 00000100:00100000:2.0:1789596865.546627:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:2.0:1789596865.546640:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:12207:x1876527961679232:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596865.546668:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.546716:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ad4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.546802:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.546813:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596865.546819:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596865.546827:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.546879:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.546897:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.546925:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1876527984819968:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596865.547042:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.549904:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1876527984819968:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596865.549954:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.549981:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc600, rc 0) 00000100:00100000:2.0:1789596865.550115:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:12207:x1876527961679232:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3478us (3760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.550126:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789596865.552748:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.552985:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961679360 00000100:00100000:2.0:1789596865.552999:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961679360 00010000:00010000:2.0:1789596865.553053:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.553106:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:2.0:1789596865.553119:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961679360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596865.553139:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596865.553283:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.553302:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.553335:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ce12274/0x7b5398e289bbf3ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07acd expref: 7 pid: 8437 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.553357:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596865.553362:0:7927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596865.553373:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.553385:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.553435:0:7927:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.553464:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7927:1876527984820096:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789596865.553611:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.558624:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.558760:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7927:1876527984820096:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789596865.558805:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596865.559065:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961679616 00000100:00100000:0.0:1789596865.559075:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961679616 00000100:00100000:0.0:1789596865.559149:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:0.0:1789596865.559161:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:12207:x1876527961679616:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:2.0:1789596865.559962:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961679360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6837us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.559976:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:0.0:1789596865.560371:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+20:12207:x1876527961679616:12345-192.168.202.16@tcp:35:bash.0 Request processed in 1209us (1763us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789596865.560381:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1789596865.638103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.638395:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961679872 00000100:00100000:2.0:1789596865.638409:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961679872 00000100:00100000:2.0:1789596865.638492:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 157 00000100:00100000:2.0:1789596865.638505:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+20:12217:x1876527961679872:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596865.638544:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.638572:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf3bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07adb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596865.638942:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789596865.639083:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf3bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07adb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.639102:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:2.0:1789596865.639106:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596865.639112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf3bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07adb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.639128:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc000, rc 0) 00000100:00100000:2.0:1789596865.639956:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12217:x1876527961679872:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1446us (1864us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789596865.639968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 157 00000100:00100000:1.0:1789596865.648312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.648523:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961680128 00000100:00100000:0.0:1789596865.648538:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961680128 00000100:00100000:0.0:1789596865.648666:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789596865.648704:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8279b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12217:x1876527961680128:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789596865.649065:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8279b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+22:12217:x1876527961680128:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 387us (769us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789596865.649074:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1789596865.731020:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.731209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961680256 00000100:00100000:2.0:1789596865.731223:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961680256 00000100:00100000:2.0:1789596865.731371:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:2.0:1789596865.731384:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d82799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+22:12223:x1876527961680256:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596865.731415:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.731442:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf3ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ae2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.731529:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf3d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.731546:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.731562:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596865.731633:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789596865.731639:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596865.731663:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.731743:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf3ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ae2 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.731768:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ae2 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.731803:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596865.731806:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596865.731811:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd200, rc 0) 00000100:00100000:2.0:1789596865.731884:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d82799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+23:12223:x1876527961680256:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 502us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.731890:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:3.0:1789596865.736452:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.736560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961680512 00000100:00100000:0.0:1789596865.736574:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961680512 00000100:00100000:0.0:1789596865.736659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:0.0:1789596865.736671:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:12223:x1876527961680512:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596865.736723:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596865.736754:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf3d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ae9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.736922:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf3df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.736939:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf3df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.736974:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf3df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596865.736986:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789596865.737130:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf3d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ae9 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.737147:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf3df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ae9 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.737154:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:0.0:1789596865.737157:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596865.737160:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789596865.737226:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12223:x1876527961680512:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 558us (791us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789596865.737233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:1.0:1789596865.740200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596865.740249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.740320:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961680768 00000100:00100000:2.0:1789596865.740334:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961680768 00000100:00100000:2.0:1789596865.740420:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:2.0:1789596865.740434:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12223:x1876527961680768:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596865.740469:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.740495:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07af0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.740633:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf3f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.740652:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.740668:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596865.740723:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789596865.740861:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf3ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af0 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.740901:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf3f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af0 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.740909:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:2.0:1789596865.740912:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789596865.740915:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dce00, rc 0) 00000100:00100000:2.0:1789596865.740978:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12223:x1876527961680768:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 549us (791us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789596865.740984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:0.0:1789596865.741281:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961680896 00000100:00100000:0.0:1789596865.741287:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961680896 00000100:00100000:0.0:1789596865.741332:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789596865.741341:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:2409:x1876527961680896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596865.741354:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596865.741370:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf3df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ae9 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.741384:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:0.0:1789596865.741387:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596865.741431:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+26:2409:x1876527961680896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 92us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.741438:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789596865.744941:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.745021:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961681024 00000100:00100000:0.0:1789596865.745033:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961681024 00000100:00100000:0.0:1789596865.745106:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1789596865.745118:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2408:x1876527961681024:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:0.0:1789596865.745182:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.745204:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.745211:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596865.745214:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596865.745218:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.745268:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.745289:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 6 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.745310:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876527984820224:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596865.745425:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.747643:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876527984820224:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596865.747736:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596865.747829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.748054:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961681152 00000100:00100000:2.0:1789596865.748064:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961681152 00002000:00100000:2.0:1789596865.748148:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c7ebb211180 x1876527961681152/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:746/0 lens 504/0 e 0 to 0 dl 1789596876 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596865.748158:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7ebb211180 with x1876527961681152 ext(0->12) 00010000:00010000:2.0:1789596865.748166:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 7 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.748181:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 7 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596865.748190:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7ebb211180 00000100:00100000:2.0:1789596865.748281:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1789596865.748292:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961681152:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:2.0:1789596865.749634:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961681152:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 1335us (1796us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789596865.749657:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00002000:00100000:2.0:1789596865.749670:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c7ebb211180 x1876527961681152/t4294967306(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:746/0 lens 504/448 e 0 to 0 dl 1789596876 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596865.749698:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7ebb211180 with x1876527961681152 ext(0->12) 00010000:00010000:2.0:1789596865.749708:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.749725:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596865.749733:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7ebb211180 00000100:00100000:1.0:1789596865.751911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596865.752024:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961681280 00000100:00100000:3.0:1789596865.752038:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961681280 00010000:00010000:3.0:1789596865.752102:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596865.752154:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:3.0:1789596865.752165:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961681280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596865.752185:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789596865.752210:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789596865.752214:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789596866 00002000:00010000:3.0:1789596865.752216:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789596866 00002000:00010000:3.0:1789596865.752218:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789596866 00002000:00010000:3.0:1789596865.752220:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789596865.752228:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.752253:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.752282:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bbf3b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ad4 expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.752305:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596865.752310:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596865.752316:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.752328:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.752374:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596865.752483:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961681280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 319us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.752492:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00010000:00010000:0.0:1789596865.754363:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754388:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754426:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754437:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754448:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754456:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596865.754461:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754472:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754496:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.754523:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7a24ef/0x7b5398e289bbf402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.754667:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961681024:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 9546us (9735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.754715:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:1.0:1789596865.761847:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.762086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961681536 00000100:00100000:2.0:1789596865.762101:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961681536 00000100:00100000:2.0:1789596865.762174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:2.0:1789596865.762187:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+26:12223:x1876527961681536:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:2.0:1789596865.762296:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf3f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af0 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596865.762560:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789596865.762598:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789596865.763075:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1789596865.763120:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.763141:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.763174:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.763220:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.763249:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 30 pid: 6519 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.763268:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876527984820352:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596865.763379:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.769300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.769396:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961681664 00000100:00100000:0.0:1789596865.769421:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961681664 00010000:00010000:0.0:1789596865.769478:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 31 pid: 6519 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.769492:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876527984820352:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596865.769525:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.769526:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:0.0:1789596865.769536:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+31:2408:x1876527961681664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596865.769558:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596865.769566:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 31 pid: 6519 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.769580:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 31 pid: 6519 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.769610:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf3a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ac6 expref: 31 pid: 6519 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.769642:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:0.0:1789596865.769648:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.769743:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.769754:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.769796:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596865.769846:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.769854:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.769861:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+30:2408:x1876527961681664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 326us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.769869:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000001:00080000:3.0:1789596865.770045:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789596865.770199:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789596865.770808:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83eead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984820480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789596865.770884:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596865.770921:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b04d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.772030:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984820480 00000100:00100000:0.0:1789596865.772045:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984820480 00000100:00100000:0.0:1789596865.772121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789596865.772133:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb029f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876527984820480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789596865.772315:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb029f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876527984820480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 185us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.772323:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789596865.772425:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83eead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984820480:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789596865.772616:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789596865.772734:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83eead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984820608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789596865.776507:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596865.776571:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b04840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.776593:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984820608 00000100:00100000:0.0:1789596865.776612:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984820608 00000100:00100000:0.0:1789596865.776738:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789596865.776750:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876527984820608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789596865.777043:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1876527984820608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 294us (542us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789596865.777052:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789596865.778827:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83eead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876527984820608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789596865.778927:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789596865.778989:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.779021:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.779028:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.779034:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596865.779039:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.779047:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.779064:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:3.0:1789596865.779078:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789596865.779083:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.780722:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf409 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596865.780895:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789596865.780967:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789596865.780980:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440599301079ns, next at 441599298107ns, rc = 0 00000001:00080000:3.0:1789596865.780991:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789596865.781032:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7eb9a7f300) 00010000:00010000:3.0:1789596865.781035:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789596865.781044:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf3f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af0 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596865.787129:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+33:12223:x1876527961681536:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 24939us (25296us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789596865.787140:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000020:00080000:3.0:1789596865.787147:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000040:00080000:2.0:1789596865.789658:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596865.789671:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596865.789852:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789596865.789867:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789596865.794185:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.794361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961681792 00000100:00100000:0.0:1789596865.794372:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961681792 00000100:00100000:0.0:1789596865.794441:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1789596865.794469:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+33:12223:x1876527961681792:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596865.794498:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596865.794523:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf410 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07af7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.794584:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af7 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.794601:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af7 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.794619:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596865.794621:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596865.794624:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596865.794729:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+34:12223:x1876527961681792:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 263us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.794737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:1.0:1789596865.797498:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.797607:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961682048 00000100:00100000:0.0:1789596865.797617:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961682048 00000100:00100000:0.0:1789596865.798222:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789596865.798250:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+34:12223:x1876527961682048:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789596865.798557:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+35:12223:x1876527961682048:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 323us (1070us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789596865.798566:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789596865.911131:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.911297:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961682304 00000100:00100000:0.0:1789596865.911311:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961682304 00000100:00100000:0.0:1789596865.911379:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:0.0:1789596865.911404:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+35:12233:x1876527961682304:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596865.911430:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596865.911449:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07afe expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596865.911562:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789596865.911734:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf417 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07afe expref: 37 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.911748:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:0.0:1789596865.911751:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596865.911756:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07afe expref: 37 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.911840:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789596865.911902:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+36:12233:x1876527961682304:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 499us (790us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1789596865.911910:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:1.0:1789596865.917108:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.917391:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961682432 00000100:00100000:0.0:1789596865.917403:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961682432 00000100:00100000:0.0:1789596865.917469:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:0.0:1789596865.917480:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+36:12233:x1876527961682432:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789596865.917569:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917589:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917620:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917634:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917642:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917659:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917771:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917780:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917786:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596865.917832:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917843:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917850:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917857:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917872:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596865.917877:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917885:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917897:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596865.917899:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596865.917904:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917910:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf425 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917922:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917928:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917934:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917939:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596865.917941:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917947:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917960:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:0.0:1789596865.917963:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596865.917965:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917971:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf42c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917978:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917984:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917990:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.917994:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596865.917997:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.918003:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.918009:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596865.918011:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596865.918013:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.918331:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf433 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.918471:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+36:12233:x1876527961682432:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 990us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.918480:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:1.0:1789596865.926299:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596865.933099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961682688 00000100:00100000:3.0:1789596865.933115:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961682688 00000100:00100000:3.0:1789596865.933173:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789596865.933184:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+36:12233:x1876527961682688:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596865.933426:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+37:12233:x1876527961682688:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 243us (7137us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789596865.933435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789596865.977410:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596865.977810:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961682944 00000100:00100000:1.0:1789596865.977846:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961682944 00000100:00100000:1.0:1789596865.977979:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:1.0:1789596865.977991:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+37:12236:x1876527961682944:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596865.978034:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596865.978059:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf43a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978140:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978155:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978166:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978178:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978184:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978189:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978308:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978317:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978324:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596865.978341:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789596865.978430:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978438:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978445:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978450:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596865.978454:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978461:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978473:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596865.978477:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596865.978481:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978488:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0600/0x7b5398e289bbf441 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978501:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978507:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978522:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978526:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596865.978529:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978535:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978543:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:1.0:1789596865.978545:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596865.978548:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978553:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf448 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978592:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf43a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978607:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.978614:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596865.978616:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596865.978620:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1800, rc 0) 00010000:00010000:3.0:1789596865.981314:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596865.981865:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:12236:x1876527961682944:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 3855us (4452us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789596865.981905:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:3.0:1789596865.984827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596865.988624:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961683072 00000100:00100000:0.0:1789596865.988642:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961683072 00000100:00100000:0.0:1789596865.989309:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:0.0:1789596865.989322:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+39:12236:x1876527961683072:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1789596865.989397:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989417:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989430:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989469:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989477:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989485:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989492:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596865.989497:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989506:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989537:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596865.989541:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596865.989547:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.989554:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf45d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.989907:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+39:12236:x1876527961683072:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 506us (5017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.989918:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:3.0:1789596865.993885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596865.998398:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961683328 00000100:00100000:2.0:1789596865.998414:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961683328 00000100:00100000:2.0:1789596865.998487:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789596865.998499:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:12236:x1876527961683328:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596865.998891:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+40:12236:x1876527961683328:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 392us (5013us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789596865.998898:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789596866.347399:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596866.363979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961683584 00000100:00100000:1.0:1789596866.364003:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961683584 00000100:00100000:0.0:1789596866.364271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:0.0:1789596866.364285:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+40:12267:x1876527961683584:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:0.0:1789596866.364325:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596866.364354:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf464 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b0c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.364501:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf46b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.364522:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.364541:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596866.364555:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789596866.364768:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf464 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b0c expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.364818:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b0c expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.364829:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596866.364833:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596866.364837:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742600, rc 0) 00000100:00100000:0.0:1789596866.364928:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12267:x1876527961683584:12345-192.168.202.16@tcp:101:cat.0 Request processed in 645us (17543us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789596866.364936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:3.0:1789596866.373635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596866.373747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596866.375729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961683968 00000100:00100000:2.0:1789596866.375749:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961683968 00000100:00100000:2.0:1789596866.375853:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789596866.375865:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+42:2406:x1876527961683968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596866.375887:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596866.375919:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf46b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b0c expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.375945:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596866.375952:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596866.376026:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+41:2406:x1876527961683968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 163us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596866.376034:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1789596866.376325:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961683840 00000100:00100000:0.0:1789596866.376332:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961683840 00000100:00100000:0.0:1789596866.376380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:0.0:1789596866.376389:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+41:12267:x1876527961683840:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:0.0:1789596866.376665:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12267:x1876527961683840:12345-192.168.202.16@tcp:35:cat.0 Request processed in 277us (3046us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789596866.376673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789596866.477878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596866.478104:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961684224 00000100:00100000:0.0:1789596866.478119:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961684224 00000100:00100000:0.0:1789596866.478210:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:0.0:1789596866.478223:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12273:x1876527961684224:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789596866.478264:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596866.478269:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789596866.478303:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf3d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ae2 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.478352:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596866.478359:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596866.478377:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf479 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b13 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.478510:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.478528:0:8967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.478539:0:8967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.478577:0:8967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.478594:0:8967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 42 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596866.478611:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984820736:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596866.479058:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836bf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596866.483272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596866.483728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961684352 00000100:00100000:3.0:1789596866.483744:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961684352 00010000:00010000:3.0:1789596866.483830:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 43 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596866.483911:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:3.0:1789596866.483923:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+43:2408:x1876527961684352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596866.483945:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596866.483954:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 43 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.483970:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 43 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.484005:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:3.0:1789596866.484011:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.484024:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.484035:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.484064:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596866.484150:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+43:2408:x1876527961684352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 228us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596866.484159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00010000:00010000:0.0:1789596866.485962:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf44f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b05 expref: 42 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596866.485999:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984820736:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596866.486049:0:8967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.486061:0:8967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.486068:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596866.486096:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789596866.486369:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf479 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 43 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.486389:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 42 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.486397:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596866.486400:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596866.486404:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789596866.486484:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12273:x1876527961684224:12345-192.168.202.16@tcp:101:dd.0 Request processed in 8263us (8622us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789596866.486493:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:1.0:1789596866.488913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596866.491658:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961684480 00000100:00100000:2.0:1789596866.491691:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961684480 00000100:00100000:2.0:1789596866.491886:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:2.0:1789596866.491901:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12273:x1876527961684480:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789596866.491939:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596866.491970:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf48e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b1a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.492016:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.492034:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.492049:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.492246:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf48e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.492270:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.492281:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596866.492285:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596866.492290:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc200, rc 0) 00000100:00100000:2.0:1789596866.492388:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+43:12273:x1876527961684480:12345-192.168.202.16@tcp:101:dd.0 Request processed in 490us (3493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596866.492397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:1.0:1789596866.493968:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984820864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596866.494055:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596866.494115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984820864 00000100:00100000:1.0:1789596866.494124:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984820864 00000100:00100000:1.0:1789596866.494175:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789596866.494185:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984820864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596866.494246:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789596866.494301:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984820864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596866.494309:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789596866.494364:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984820864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596866.498945:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596866.510351:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961684736 00000100:00100000:0.0:1789596866.510376:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961684736 00000100:00100000:0.0:1789596866.510518:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:0.0:1789596866.510532:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+43:12273:x1876527961684736:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:0.0:1789596866.511174:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.511222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.511248:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596866.511312:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1789596866.511337:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004229dc74 reply state 000000005fd13431 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.511352:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.511360:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596866.511364:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596866.511369:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596866.511956:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+46:12273:x1876527961684736:12345-192.168.202.16@tcp:36:dd.0 Request processed in 1418us (13021us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789596866.511967:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000020:00080000:0.0:1789596866.511974:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789596866.552343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596866.552392:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596866.552430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596866.552466:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596866.552624:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961684992 00000100:00100000:0.0:1789596866.552638:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961684992 00000100:00100000:0.0:1789596866.552745:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961685248 00000100:00100000:0.0:1789596866.552749:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961685248 00000100:00100000:1.0:1789596866.556215:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961685120 00000100:00100000:1.0:1789596866.556250:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961685120 00000100:00100000:1.0:1789596866.556362:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:1.0:1789596866.556375:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961685120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596866.556486:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961685120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 114us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596866.556514:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:1.0:1789596866.556621:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:1.0:1789596866.556818:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596866.556824:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596866.556842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961685376 00000100:00100000:1.0:1789596866.556847:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961685376 00000100:00080000:1.0:1789596866.556865:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596866.556897:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 347 00000100:00100000:1.0:1789596866.556905:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961684992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596866.556949:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961684992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596866.556956:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 347 00000100:00100000:1.0:1789596866.556973:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 348 00000100:00100000:1.0:1789596866.556981:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961685376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596866.557008:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961685376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596866.557015:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 348 00000100:00100000:0.0:1789596866.558426:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 349 00000100:00100000:0.0:1789596866.558440:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961685248:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596866.558508:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961685248:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 72us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596866.558515:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 349 00000100:00080000:1.0:1789596866.558934:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596866.559150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961684864 00000100:00100000:2.0:1789596866.559160:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961684864 00000100:00100000:2.0:1789596866.559214:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 395 00000100:00100000:2.0:1789596866.559222:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961684864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596866.559288:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961684864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 67us (6857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596866.559296:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 395 00000100:00100000:1.0:1789596866.853085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596866.853216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961685504 00000100:00100000:0.0:1789596866.853241:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961685504 00000100:00100000:0.0:1789596866.853323:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:0.0:1789596866.853335:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+46:12288:x1876527961685504:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:0.0:1789596866.853369:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596866.853395:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b21 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853512:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853531:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853545:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853557:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853564:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853571:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853668:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853724:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 47 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853746:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853789:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 47 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.853820:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 47 pid: 8967 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596866.853838:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984820992:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596866.854164:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596866.857599:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984820992:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596866.857643:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596866.860484:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596866.860615:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961685760 00000100:00100000:0.0:1789596866.860630:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961685760 00000100:00100000:0.0:1789596866.860820:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789596866.860834:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+48:6177:x1876527961685760:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789596866.861296:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+49:6177:x1876527961685760:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 462us (825us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789596866.861306:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:1.0:1789596866.864219:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596866.864929:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961685888 00000100:00100000:2.0:1789596866.864944:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961685888 00010000:00010000:2.0:1789596866.865004:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 49 pid: 8967 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596866.865106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:2.0:1789596866.865119:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+49:2409:x1876527961685888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596866.865163:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596866.865172:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 49 pid: 8967 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.865188:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 49 pid: 8967 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.865214:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf480 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b13 expref: 49 pid: 8967 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.865246:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596866.865253:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.865266:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.865277:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.865318:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596866.865639:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+48:2409:x1876527961685888:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 521us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596866.865648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00010000:00010000:0.0:1789596866.871544:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871569:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596866.871762:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789596866.871768:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596866.871806:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871829:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871843:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871850:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871860:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871867:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596866.871871:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871880:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871901:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596866.871905:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596866.871911:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871918:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf4aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871956:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871963:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871969:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871975:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596866.871978:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871985:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.871993:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:0.0:1789596866.871996:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596866.871999:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.872004:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf4b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.872056:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b21 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.872073:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b21 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.872092:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596866.872094:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596866.872097:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742600, rc 0) 00000100:00100000:0.0:1789596866.872202:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+47:12288:x1876527961685504:12345-192.168.202.16@tcp:101:stat.0 Request processed in 18867us (19130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596866.872213:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:1.0:1789596866.932119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596866.932330:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961686144 00000100:00100000:0.0:1789596866.932345:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961686144 00000100:00100000:0.0:1789596866.932485:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:0.0:1789596866.932499:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+47:12294:x1876527961686144:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:0.0:1789596866.933439:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596866.933486:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b21 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.933518:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596866.933524:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596866.933839:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.933857:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.933869:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596866.933924:0:8967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1789596866.933949:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d7d464 reply state 000000009afadeee transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.933983:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.933990:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596866.933993:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596866.934009:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596866.934150:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+49:12294:x1876527961686144:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 1653us (2047us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789596866.934161:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000020:00080000:0.0:1789596866.934168:0:8967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789596867.005361:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596867.044522:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596867.044858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961686272 00000100:00100000:2.0:1789596867.044874:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961686272 00000100:00100000:2.0:1789596867.045040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:2.0:1789596867.045054:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+49:12308:x1876527961686272:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:2.0:1789596867.045122:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596867.045153:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf4c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b28 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045254:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045274:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045291:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045305:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045320:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045423:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045433:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045440:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596867.045493:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789596867.045504:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596867.045534:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045549:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045558:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045565:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045572:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045578:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596867.045584:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045592:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045607:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596867.045610:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596867.045616:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045623:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf4cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045639:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045656:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045662:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045667:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596867.045670:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045733:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045744:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:2.0:1789596867.045747:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596867.045760:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045768:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf4d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045803:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf4c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045818:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596867.045827:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596867.045829:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596867.045839:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd200, rc 0) 00000100:00100000:2.0:1789596867.045925:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+50:12308:x1876527961686272:12345-192.168.202.16@tcp:101:stat.0 Request processed in 874us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596867.045933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00080000:1.0:1789596867.051849:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596867.133340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.133600:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961686528 00000100:00100000:0.0:1789596867.133615:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961686528 00000100:00100000:0.0:1789596867.133991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:0.0:1789596867.134119:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+50:12318:x1876527961686528:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596867.134149:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.134176:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b2f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596867.134329:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789596867.134474:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b2f expref: 52 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.134492:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:0.0:1789596867.134496:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596867.134503:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf4e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b2f expref: 52 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.134539:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742600, rc 0) 00000100:00100000:0.0:1789596867.134643:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+51:12318:x1876527961686528:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 538us (1319us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1789596867.140401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:2.0:1789596867.140569:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.140898:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961686784 00000100:00100000:3.0:1789596867.140911:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961686784 00000100:00100000:3.0:1789596867.141289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789596867.141305:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+51:12318:x1876527961686784:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596867.141938:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+52:12318:x1876527961686784:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 633us (1364us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789596867.141949:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789596867.205425:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.205564:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961687040 00000100:00100000:0.0:1789596867.205580:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961687040 00000100:00100000:0.0:1789596867.205672:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:0.0:1789596867.205738:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+52:12324:x1876527961687040:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789596867.208761:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596867.208808:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf4f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b36 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.209209:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.209243:0:8967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.209254:0:8967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.209305:0:8967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.209330:0:8967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 53 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596867.209348:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984821120:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596867.209573:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596867.214033:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8967:1876527984821120:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596867.214075:0:8967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596867.216377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.216436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961687168 00000100:00100000:3.0:1789596867.216451:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961687168 00010000:00010000:3.0:1789596867.216508:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 54 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596867.216662:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1789596867.217317:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+54:2408:x1876527961687168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596867.217345:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596867.217355:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 54 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.217372:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 54 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.217404:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf4db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b28 expref: 54 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.217424:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:3.0:1789596867.217429:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.217459:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.217468:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.217580:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596867.217673:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+53:2408:x1876527961687168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 998us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.217728:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00010000:00010000:1.0:1789596867.219455:0:8967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.219473:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596867.219502:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789596867.219892:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf4f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 54 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.219942:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 53 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.219952:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596867.219956:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596867.219960:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0000, rc 0) 00000100:00100000:1.0:1789596867.220169:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+53:12324:x1876527961687040:12345-192.168.202.16@tcp:101:bash.0 Request processed in 14434us (14759us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789596867.220180:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:2.0:1789596867.223516:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.223597:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961687424 00000100:00100000:0.0:1789596867.223611:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961687424 00000100:00100000:0.0:1789596867.223720:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:0.0:1789596867.223732:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+53:12324:x1876527961687424:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:0.0:1789596867.224094:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.224120:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.224135:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596867.224191:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1789596867.224216:0:11184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d631f5a reply state 00000000b40ec4c4 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.224244:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.224275:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.224278:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596867.224283:0:11184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596867.224957:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12324:x1876527961687424:12345-192.168.202.16@tcp:36:bash.0 Request processed in 1218us (1446us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789596867.224968:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 175 00000020:00080000:0.0:1789596867.224975:0:11184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789596867.231573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.232279:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961687552 00000100:00100000:0.0:1789596867.232295:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961687552 00000100:00100000:0.0:1789596867.232522:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:0.0:1789596867.232538:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12324:x1876527961687552:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789596867.232572:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.232600:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf50c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b3d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.232778:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.232796:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 57 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.232805:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.232854:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 57 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.232871:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 57 pid: 8967 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596867.232908:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984821248:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596867.233033:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836bfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596867.236673:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.236830:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961687680 00000100:00100000:3.0:1789596867.236843:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961687680 00010000:00010000:3.0:1789596867.236895:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 58 pid: 8967 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596867.236937:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1789596867.236949:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+58:2408:x1876527961687680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596867.236968:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596867.236976:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 58 pid: 8967 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.236991:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 58 pid: 8967 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.237020:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:3.0:1789596867.237026:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.237060:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.237070:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.237095:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596867.237171:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+58:2408:x1876527961687680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 223us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.237179:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00010000:00010000:0.0:1789596867.237642:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0000/0x7b5398e289bbf4f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b36 expref: 57 pid: 8967 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596867.237664:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984821248:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596867.237822:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.237835:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.237842:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596867.237919:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789596867.237926:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596867.237951:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.237992:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf50c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b3d expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.238011:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b3d expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.238020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.238035:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596867.238039:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742200, rc 0) 00000100:00100000:0.0:1789596867.238096:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12324:x1876527961687552:12345-192.168.202.16@tcp:101:bash.0 Request processed in 5562us (7160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.238104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:1.0:1789596867.244150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.244360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961687936 00000100:00100000:0.0:1789596867.244373:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961687936 00000100:00100000:0.0:1789596867.244447:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789596867.244460:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12324:x1876527961687936:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1789596867.244784:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+57:12324:x1876527961687936:12345-192.168.202.16@tcp:35:bash.0 Request processed in 326us (647us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789596867.244793:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789596867.366393:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.367010:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961688192 00000100:00100000:1.0:1789596867.367030:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961688192 00000100:00100000:1.0:1789596867.367180:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:1.0:1789596867.367193:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+57:12334:x1876527961688192:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596867.367236:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596867.367272:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf51a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b44 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596867.367436:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789596867.367589:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf51a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b44 expref: 59 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.367606:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:1.0:1789596867.367610:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596867.367651:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf51a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b44 expref: 59 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.367669:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0400, rc 0) 00000100:00100000:1.0:1789596867.367819:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12334:x1876527961688192:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 628us (1452us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1789596867.367828:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:2.0:1789596867.376094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.377577:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961688320 00000100:00100000:0.0:1789596867.377599:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961688320 00000100:00100000:0.0:1789596867.377739:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:0.0:1789596867.377753:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12334:x1876527961688320:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789596867.377864:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.377888:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.377903:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.377916:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.377950:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.377957:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378057:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378068:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378075:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596867.378137:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378155:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378163:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378171:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378179:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596867.378184:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378194:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378218:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596867.378235:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596867.378242:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378318:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf528 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378339:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378346:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378352:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378358:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596867.378361:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378430:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378440:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:0.0:1789596867.378442:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596867.378446:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378452:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf52f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378473:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378480:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378486:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378492:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596867.378495:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378501:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378509:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.378511:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596867.378515:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.378521:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf536 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596867.378635:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12334:x1876527961688320:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 883us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.378645:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:0.0:1789596867.381080:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.381167:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961688576 00000100:00100000:3.0:1789596867.381183:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961688576 00000100:00100000:3.0:1789596867.381272:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789596867.381284:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12334:x1876527961688576:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596867.381810:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+59:12334:x1876527961688576:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 525us (741us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789596867.381820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1789596867.434850:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.435120:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961688832 00000100:00100000:0.0:1789596867.435135:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961688832 00000100:00100000:0.0:1789596867.435246:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:0.0:1789596867.435266:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+59:12337:x1876527961688832:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596867.435303:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.435332:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf53d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b4b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435439:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435458:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435474:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435486:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435494:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435502:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435909:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf552 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435921:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.435929:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596867.435955:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789596867.436126:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436135:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436143:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436150:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596867.436154:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436164:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436180:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596867.436184:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596867.436190:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436198:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf544 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436215:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436232:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436259:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436265:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596867.436268:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436275:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436282:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:0.0:1789596867.436285:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596867.436289:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436294:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf54b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436343:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf53d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b4b expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.436360:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b4b expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.438739:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.438744:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596867.438750:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742a00, rc 0) 00000100:00100000:0.0:1789596867.439736:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+61:12337:x1876527961688832:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 3981us (4411us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789596867.440097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:2.0:1789596867.446741:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596867.446856:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.447561:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961689088 00000100:00100000:0.0:1789596867.447576:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961689088 00000100:00100000:0.0:1789596867.447663:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789596867.447674:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+61:2408:x1876527961689088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596867.447724:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596867.447758:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf552 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b4b expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.447780:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.447786:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596867.447860:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+60:2408:x1876527961689088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 187us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.447869:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1789596867.447956:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961688960 00000100:00100000:1.0:1789596867.447962:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961688960 00000100:00100000:1.0:1789596867.448021:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:1.0:1789596867.448029:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+60:12337:x1876527961688960:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1789596867.448114:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448132:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448147:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448205:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448212:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448219:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448235:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596867.448241:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448334:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448343:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596867.448347:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596867.448351:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.448358:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bbf560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596867.448540:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+60:12337:x1876527961688960:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 511us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596867.448548:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:2.0:1789596867.457127:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.457347:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961689344 00000100:00100000:3.0:1789596867.457363:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961689344 00000100:00100000:3.0:1789596867.457530:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1789596867.457542:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+60:12337:x1876527961689344:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596867.457890:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+61:12337:x1876527961689344:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 348us (779us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789596867.457900:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789596867.667754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.667915:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961689600 00000100:00100000:0.0:1789596867.667927:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961689600 00000100:00100000:0.0:1789596867.667995:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:0.0:1789596867.668006:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+61:12355:x1876527961689600:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:0.0:1789596867.668035:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.668061:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf567 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b52 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.668194:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf56e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.668212:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf56e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.668263:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf56e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596867.668276:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789596867.668412:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf567 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b52 expref: 64 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.668438:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf56e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b52 expref: 63 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.668447:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.668450:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789596867.668454:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742000, rc 0) 00000100:00100000:0.0:1789596867.668945:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12355:x1876527961689600:12345-192.168.202.16@tcp:101:cat.0 Request processed in 937us (1201us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789596867.668954:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:2.0:1789596867.706773:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.706980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961689728 00000100:00100000:0.0:1789596867.706996:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961689728 00000100:00100000:0.0:1789596867.707093:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:0.0:1789596867.707107:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12356:x1876527961689728:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596867.707140:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.707168:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf57c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b59 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.707276:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.707334:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.707350:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596867.707425:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789596867.707430:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596867.707458:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.707496:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf57c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b59 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.707520:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b59 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.707529:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596867.707533:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596867.707538:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742c00, rc 0) 00000100:00100000:0.0:1789596867.707628:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12356:x1876527961689728:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 524us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.707636:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:2.0:1789596867.711966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.713166:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961690112 00000100:00100000:0.0:1789596867.713185:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961690112 00000100:00100000:3.0:1789596867.713435:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1789596867.713452:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12356:x1876527961690112:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596867.714166:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12356:x1876527961690112:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 714us (2213us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789596867.714177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:2.0:1789596867.717267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.717509:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961690240 00000100:00100000:3.0:1789596867.717526:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961690240 00000100:00100000:3.0:1789596867.717616:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789596867.717640:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12356:x1876527961690240:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:3.0:1789596867.717665:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789596867.717763:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b3d expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.717792:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf56e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b52 expref: 64 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.717804:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf410 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07af7 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.717814:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:3.0:1789596867.717821:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596867.717898:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+62:12356:x1876527961690240:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 261us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.717906:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789596867.725464:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.725546:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961690368 00000100:00100000:0.0:1789596867.725560:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961690368 00000100:00100000:0.0:1789596867.725633:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1789596867.725645:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+62:12356:x1876527961690368:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:0.0:1789596867.725852:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.725875:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.725890:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596867.726031:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789596867.726142:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+62:12356:x1876527961690368:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 498us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.726152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1789596867.761067:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.761411:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961690496 00000100:00100000:1.0:1789596867.761423:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961690496 00000100:00100000:1.0:1789596867.761528:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:1.0:1789596867.761539:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+62:12358:x1876527961690496:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596867.761561:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596867.761583:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bbf591 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b60 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761670:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761740:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761783:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761796:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761804:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761810:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761893:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761903:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.761909:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596867.761954:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789596867.761959:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596867.761979:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762004:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762014:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762031:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762039:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762045:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596867.762049:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762056:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762068:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596867.762071:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596867.762076:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762082:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf598 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762094:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762110:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762116:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762121:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596867.762130:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762136:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762144:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:1.0:1789596867.762146:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596867.762149:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762156:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbf59f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762519:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bbf591 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 64 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762537:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 63 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.762545:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596867.762547:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596867.762550:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1c00, rc 0) 00000100:00100000:1.0:1789596867.762672:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12358:x1876527961690496:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1134us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596867.762720:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00000040:00080000:2.0:1789596867.836964:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596867.836976:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596867.837013:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789596867.837023:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596867.837364:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984821376:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789596867.837501:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596867.844300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.844770:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961690624 00000100:00100000:1.0:1789596867.844785:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961690624 00000100:00100000:1.0:1789596867.844861:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:1.0:1789596867.844876:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961690624:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596867.844935:0:8967:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596867.845097:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961690624:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 225us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596867.845117:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:2.0:1789596867.845438:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984821376:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789596867.849834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.849999:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961690752 00000100:00100000:3.0:1789596867.850012:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961690752 00000100:00100000:3.0:1789596867.850079:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:3.0:1789596867.850090:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12369:x1876527961690752:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789596867.850186:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850213:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850300:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850309:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850315:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850344:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850353:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850361:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596867.850590:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789596867.850596:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596867.850609:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.850622:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851201:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851208:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851214:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596867.851227:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851236:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851249:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:3.0:1789596867.851252:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596867.851257:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851264:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf5ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851281:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851287:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851294:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851301:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596867.851313:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851318:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851326:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9c7d825db200) 00010000:00010000:3.0:1789596867.851329:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596867.851332:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851337:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851352:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851357:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851362:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851368:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596867.851370:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.851375:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.852351:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:3.0:1789596867.852358:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596867.852369:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.852377:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596867.852493:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12369:x1876527961690752:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 2399us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.852503:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:3.0:1789596867.864600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.864844:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961691008 00000100:00100000:0.0:1789596867.864856:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961691008 00000100:00100000:0.0:1789596867.866296:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:0.0:1789596867.866314:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12369:x1876527961691008:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596867.866339:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.866361:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf5c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b67 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866484:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866501:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866514:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596867.866533:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789596867.866614:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866622:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866629:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866635:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596867.866640:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866649:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866662:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:0.0:1789596867.866665:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596867.866670:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866696:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf5c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866742:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf5c2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b67 expref: 65 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866752:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:0.0:1789596867.866754:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596867.866765:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf5c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b67 expref: 65 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.866776:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596867.866846:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961691008:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 539us (2256us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789596867.866853:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:2.0:1789596867.873031:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.873263:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961691136 00000100:00100000:3.0:1789596867.873274:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961691136 00000100:00100000:3.0:1789596867.873342:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:3.0:1789596867.873352:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961691136:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596867.873390:0:8967:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596867.873518:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961691136:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 168us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.873527:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:3.0:1789596867.876545:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.876587:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961691392 00000100:00100000:3.0:1789596867.876597:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961691392 00000100:00100000:3.0:1789596867.876646:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:3.0:1789596867.876655:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961691392:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596867.876675:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596867.876697:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789596867.876723:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b59 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.877988:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:3.0:1789596867.877994:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596867.878014:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b6e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596867.878438:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789596867.878578:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf5de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.878591:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.878603:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.878675:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b6e expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.878715:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b6e expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.878723:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825dba00) 00010000:00010000:3.0:1789596867.878726:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596867.878728:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671a00, rc 0) 00000100:00100000:3.0:1789596867.880114:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12369:x1876527961691392:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 3452us (3570us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789596867.880126:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:0.0:1789596867.892928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.895256:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961691648 00000100:00100000:3.0:1789596867.895272:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961691648 00000100:00100000:3.0:1789596867.895343:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:3.0:1789596867.895354:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12369:x1876527961691648:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596867.895416:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596867.895442:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b6e expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895458:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825dba00) 00010000:00010000:3.0:1789596867.895469:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596867.895490:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895505:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895516:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895530:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895537:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895544:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895592:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895614:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895621:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895627:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596867.895632:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895639:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895647:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:3.0:1789596867.895650:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596867.895655:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895660:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf5ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895669:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895675:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895698:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895703:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596867.895712:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895719:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895727:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xca9c47f7 (ffff9c7d825db200) 00010000:00010000:3.0:1789596867.895729:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596867.895733:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.895739:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf5f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xca9c47f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596867.895837:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961691648:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 484us (2919us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596867.895844:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:0.0:1789596867.902578:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.902738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961691776 00000100:00100000:3.0:1789596867.902808:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961691776 00000100:00100000:3.0:1789596867.902865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:3.0:1789596867.902875:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12369:x1876527961691776:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596867.902896:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596867.902918:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.902956:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.902970:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.903002:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.903116:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf5fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.903135:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.903144:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:3.0:1789596867.903147:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789596867.903151:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670e00, rc 0) 00000100:00100000:3.0:1789596867.903209:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12369:x1876527961691776:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 335us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.903231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:3.0:1789596867.910470:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.910966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961692032 00000100:00100000:0.0:1789596867.910977:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961692032 00000100:00100000:0.0:1789596867.911043:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:0.0:1789596867.911053:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12369:x1876527961692032:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596867.911139:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.911158:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.911170:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596867.911356:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1789596867.911366:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442729687051ns, next at 443729684309ns, rc = 0 00000004:00010000:0.0:1789596867.911417:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e61ee07f reply state 00000000c5cc2679 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.911432:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.911457:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:0.0:1789596867.911460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789596867.911465:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596867.911576:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12369:x1876527961692032:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 523us (1114us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789596867.911583:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:0.0:1789596867.918658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.921381:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961692160 00000100:00100000:1.0:1789596867.921395:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961692160 00000100:00100000:1.0:1789596867.921465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:1.0:1789596867.921476:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12369:x1876527961692160:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596867.921500:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596867.921520:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.921581:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.921596:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.921615:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:1.0:1789596867.921618:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789596867.921621:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1a00, rc 0) 00000100:00100000:1.0:1789596867.921703:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+68:12369:x1876527961692160:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 228us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596867.921710:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:0.0:1789596867.927906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596867.928240:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961692288 00000100:00100000:2.0:1789596867.928251:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961692288 00000100:00100000:2.0:1789596867.928312:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1789596867.928323:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+6:2407:x1876527961692288:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789596867.928559:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2407:x1876527961692288:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 237us (663us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789596867.928567:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1789596867.941952:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596867.942074:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961692544 00000100:00100000:2.0:1789596867.942085:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961692544 00000100:00100000:2.0:1789596867.942212:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789596867.942231:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+68:12369:x1876527961692544:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789596867.942454:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+69:12369:x1876527961692544:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 224us (511us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789596867.942462:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1789596867.945667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.947889:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961692800 00000100:00100000:0.0:1789596867.947905:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961692800 00000100:00100000:0.0:1789596867.947969:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:0.0:1789596867.947980:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+69:12369:x1876527961692800:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789596867.948238:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+69:12369:x1876527961692800:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 258us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.948247:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:2.0:1789596867.957912:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.958284:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961692928 00000100:00100000:1.0:1789596867.958304:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961692928 00000100:00100000:1.0:1789596867.958367:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:1.0:1789596867.958379:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+69:12369:x1876527961692928:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596867.958402:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596867.958423:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf616 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b83 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.958498:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf61d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.958515:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.958527:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596867.958575:0:8967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596867.958600:0:8967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.958631:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bbf616 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b83 expref: 71 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.958652:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf61d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b83 expref: 70 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.958661:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:1.0:1789596867.958664:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789596867.958668:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1e00, rc 0) 00000100:00100000:1.0:1789596867.958927:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+70:12369:x1876527961692928:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 548us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596867.958943:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:3.0:1789596867.961896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596867.962060:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693056 00000100:00100000:0.0:1789596867.962071:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693056 00000100:00100000:0.0:1789596867.962132:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789596867.962142:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2407:x1876527961693056:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596867.962159:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596867.962179:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b8a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596867.962204:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab14c4, blocks: 0x0 00010000:00010000:0.0:1789596867.962235:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1789596867.962253:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596867.962262:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.962284:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596867.962298:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789596867.962370:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2407:x1876527961693056:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 229us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596867.962376:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789596867.965007:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596867.965083:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693312 00000100:00100000:3.0:1789596867.965093:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693312 00000100:00100000:3.0:1789596867.965150:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:3.0:1789596867.965160:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+70:12369:x1876527961693312:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789596867.965283:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+70:12369:x1876527961693312:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 122us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.965290:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:3.0:1789596867.968838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.968930:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693440 00000100:00100000:1.0:1789596867.968940:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693440 00000100:00100000:1.0:1789596867.969011:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789596867.969021:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:12369:x1876527961693440:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596867.969042:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596867.969059:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b91 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.969091:0:9893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.969099:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596867.969104:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596867.969109:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 9 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.969141:0:9893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.969154:0:9893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 9 pid: 8435 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596867.969169:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984821504:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596867.969264:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789596867.972889:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596867.972922:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693568 00000100:00100000:1.0:1789596867.972931:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693568 00010000:00010000:1.0:1789596867.972971:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 10 pid: 8435 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596867.973016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:1.0:1789596867.973026:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2409:x1876527961693568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596867.973042:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596867.973063:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 10 pid: 8435 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.973077:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 10 pid: 8435 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.973105:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596867.973110:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596867.973118:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 10 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.973128:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 10 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596867.973162:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 10 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596867.973176:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1876527984821632:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789596867.973273:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af46c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789596867.973448:0:9893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f237583/0x7b5398e289bbf624 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b8a expref: 10 pid: 8435 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596867.973473:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984821504:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596867.973498:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 9 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596867.973508:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1800, rc 0) 00000100:00100000:3.0:1789596867.973555:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+9:12369:x1876527961693440:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 4535us (4728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.973563:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789596867.982464:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1876527984821632:192.168.202.16@tcp:105: 00010000:00010000:3.0:1789596867.982493:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596867.982555:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961693568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9529us (9673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596867.982566:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:0.0:1789596867.996085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596867.996164:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693696 00000100:00100000:2.0:1789596867.996174:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693696 00002000:00100000:2.0:1789596867.996230:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c7d837b5f80 x1876527961693696/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:748/0 lens 504/0 e 0 to 0 dl 1789596878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596867.996242:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d837b5f80 with x1876527961693696 ext(0->8) 00002000:00010000:2.0:1789596867.996248:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d837b5f80 00000100:00100000:2.0:1789596867.996279:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1789596867.996288:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961693696:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789596867.997173:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2408:x1876527961693696:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 880us (1091us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789596867.997193:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00002000:00100000:2.0:1789596867.997202:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c7d837b5f80 x1876527961693696/t4294967315(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:748/0 lens 504/448 e 0 to 0 dl 1789596878 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596867.997211:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d837b5f80 with x1876527961693696 ext(0->8) 00002000:00010000:2.0:1789596867.997224:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d837b5f80 00000100:00100000:1.0:1789596868.005155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596868.007213:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693824 00000100:00100000:0.0:1789596868.007239:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693824 00000100:00100000:0.0:1789596868.007307:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:0.0:1789596868.007319:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+70:12369:x1876527961693824:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789596868.009345:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789596868.009365:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1789596868.009425:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789596868.009442:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7eb9b04d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789596868.009448:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d844dee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7eb9b04900 00000020:00080000:0.0:1789596868.009451:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d844ded00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7e8698f600 00000020:00080000:0.0:1789596868.009488:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789596868.009552:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789596868.009719:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12369:x1876527961693824:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 2397us (4567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596868.009749:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 197 00010000:00010000:1.0:1789596868.011410:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011429:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011438:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011445:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.011450:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011457:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011474:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7eb9a7f900) 00010000:00010000:1.0:1789596868.011477:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596868.011482:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011489:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf353 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011513:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011520:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011544:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011550:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.011553:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011559:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011568:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596868.011570:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596868.011573:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011579:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0e00/0x7b5398e289bbf35a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011595:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011601:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011608:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011613:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.011615:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011631:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011639:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7eb9a7f000) 00010000:00010000:1.0:1789596868.011642:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596868.011645:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011651:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bbf399 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011667:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.011674:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596868.012816:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984821760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789596868.012884:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596868.012941:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984821760 00000100:00100000:0.0:1789596868.012949:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984821760 00000100:00100000:0.0:1789596868.013019:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596868.013029:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984821760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789596868.013147:0:14227:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789596868.013150:0:14227:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789596868 00002000:00010000:0.0:1789596868.013153:0:14227:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789596868.013155:0:14227:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789596868 -> 1789596868 00002000:00010000:0.0:1789596868.013158:0:14227:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789596868.013195:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984821760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (311us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789596868.013202:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:0.0:1789596868.013259:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d837b7800/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789596868.013266:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984821760:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789596868.015858:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015866:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.015872:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015881:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015898:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596868.015901:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596868.015905:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015930:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf49c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015951:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015958:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015963:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015967:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.015970:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015976:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.015983:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596868.015985:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596868.015998:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016004:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf4bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016013:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016018:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016029:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016034:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.016037:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016042:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016049:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:1.0:1789596868.016051:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596868.016054:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016059:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742600/0x7b5398e289bbf505 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016070:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016075:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016080:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016085:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596868.016087:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016100:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016108:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:1.0:1789596868.016110:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789596868.016113:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016118:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf608 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789596868.016223:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596868.016242:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984821888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789596868.016301:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596868.016346:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984821888 00000100:00100000:1.0:1789596868.016352:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984821888 00000100:00100000:1.0:1789596868.016402:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789596868.016410:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984821888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789596868.016433:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1789596868.016462:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aab14c2, atime: 0x6aab14c2, ctime: 0x6aab14c2, blocks: 0x8 00010000:00010000:1.0:1789596868.016469:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016482:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1789596868.016487:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596868.016494:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016519:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016529:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016537:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.016554:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789596868.016936:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596868.016962:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961693952 00000100:00100000:0.0:1789596868.016967:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961693952 00000100:00100000:0.0:1789596868.017008:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789596868.017016:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2406:x1876527961693952:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789596868.017627:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876527984821888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1216us (1323us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789596868.017634:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789596868.017655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596868.017658:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789596868.017669:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596868.017699:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.017709:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596868.017714:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.017723:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596868.017885:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d837b8380/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789596868.017892:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984821888:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789596868.018623:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1789596868.018640:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789596868.018763:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2406:x1876527961693952:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 1746us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596868.018772:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00010000:00010000:1.0:1789596868.018885:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.018894:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbf632 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.018918:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596868.018920:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596868.018922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596868.028110:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596868.028200:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961694208 00000100:00100000:2.0:1789596868.028211:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961694208 00000100:00100000:2.0:1789596868.028290:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:2.0:1789596868.028300:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+19:12369:x1876527961694208:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789596868.028353:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596868.028382:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf61d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b83 expref: 19 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.028400:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:2.0:1789596868.028404:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596868.028435:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.028450:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.028461:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596868.028587:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d94255f3 reply state 000000000008f503 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.028621:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.028628:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:2.0:1789596868.028630:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596868.028633:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596868.028823:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:12369:x1876527961694208:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 523us (720us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789596868.028831:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 198 00010000:00010000:3.0:1789596868.036180:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596868.036315:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596868.036509:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961694336 00000100:00100000:3.0:1789596868.036519:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961694336 00000100:00100000:3.0:1789596868.036579:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1789596868.036590:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961694336:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789596868.036775:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789596868.036779:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789596868 -> 1789596867 00002000:00010000:3.0:1789596868.036782:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789596866 00002000:00010000:3.0:1789596868.036784:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789596868 -> 1789596867 00002000:00010000:3.0:1789596868.036787:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789596868.036859:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961694336:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 271us (551us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789596868.036867:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789596868.039204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596868.039279:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961694592 00000100:00100000:3.0:1789596868.039289:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961694592 00000100:00100000:3.0:1789596868.039341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00100000:3.0:1789596868.039350:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+20:12369:x1876527961694592:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789596868.039417:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.039435:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.039444:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.039477:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.039490:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 20 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596868.039504:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83eeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984822016:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596868.039713:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596868.043515:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83eeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984822016:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596868.043544:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596868.045583:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596868.045749:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961694720 00000100:00100000:3.0:1789596868.045761:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961694720 00010000:00010000:3.0:1789596868.045801:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 21 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596868.045851:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:3.0:1789596868.045861:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+21:2409:x1876527961694720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596868.045876:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596868.045883:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 21 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.045895:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 21 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.045915:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf601 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b75 expref: 21 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.045930:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:3.0:1789596868.045935:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.045945:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.045953:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.045980:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596868.046045:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:2409:x1876527961694720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 185us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596868.046052:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00010000:00010000:0.0:1789596868.046501:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046510:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046550:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046558:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046565:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046571:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596868.046576:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046583:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046601:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:0.0:1789596868.046604:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789596868.046608:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.046613:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf640 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596868.046700:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+19:12369:x1876527961694592:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 7327us (7482us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789596868.046708:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00100000:0.0:1789596868.054474:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596868.054561:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961694848 00000100:00100000:1.0:1789596868.054572:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961694848 00000100:00100000:1.0:1789596868.054636:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789596868.054646:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961694848:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789596868.054719:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.054741:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 8 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.054766:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596868.054771:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596868.054776:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.054828:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 8 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.054861:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 8 pid: 9893 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596868.054887:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984822144:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596868.054974:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596868.066712:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984822144:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596868.066754:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596868.069263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596868.069350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961694976 00000100:00100000:3.0:1789596868.069375:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961694976 00010000:00010000:3.0:1789596868.069413:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 9 pid: 9893 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596868.069461:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:3.0:1789596868.069471:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961694976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596868.069485:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596868.069508:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 9 pid: 9893 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.069523:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 9 pid: 9893 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.069546:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbf62b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b91 expref: 9 pid: 9893 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.069564:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596868.069569:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596868.069575:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.069585:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.069630:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596868.069716:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961694976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 246us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596868.069734:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00010000:00010000:0.0:1789596868.069962:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.069973:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070005:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070015:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070023:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070041:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596868.070045:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070054:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070066:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596868.070074:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bbf647 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596868.070135:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961694848:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 15490us (15678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596868.070143:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789596868.083980:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596868.084152:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961695232 00000100:00100000:2.0:1789596868.084163:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961695232 00000100:00100000:2.0:1789596868.084225:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:2.0:1789596868.084237:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+19:12369:x1876527961695232:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789596868.084316:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.084333:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.084342:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.084376:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.084390:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 19 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596868.084424:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984822272:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596868.084506:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1789596868.087897:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596868.089868:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961695360 00000100:00100000:2.0:1789596868.089886:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961695360 00010000:00010000:2.0:1789596868.089932:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 20 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596868.089970:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:2.0:1789596868.089980:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:2408:x1876527961695360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596868.089996:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596868.090004:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 20 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.090018:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 20 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.090042:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596868.090047:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.090057:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.090065:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.090087:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596868.090159:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+20:2408:x1876527961695360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 179us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596868.090168:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00010000:00010000:1.0:1789596868.094604:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b1a expref: 19 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596868.094632:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984822272:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596868.094660:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.094824:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.094832:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.095212:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.095421:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.095429:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.095479:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.095494:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 19 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596868.095507:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984822400:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596868.095600:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789596868.103344:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984822400:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596868.103379:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596868.104831:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596868.105022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961695488 00000100:00100000:3.0:1789596868.105032:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961695488 00010000:00010000:3.0:1789596868.105079:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 20 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596868.105123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:3.0:1789596868.105135:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+20:2409:x1876527961695488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596868.105150:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596868.105158:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 20 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.105172:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 20 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.105197:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1a00/0x7b5398e289bbf60f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b7c expref: 20 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.105211:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:3.0:1789596868.105227:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.105238:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.105246:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.105293:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596868.105351:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:2409:x1876527961695488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 218us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596868.105359:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00010000:00010000:1.0:1789596868.105549:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.105558:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596868.105668:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789596868.108506:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1789596868.108559:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789596868.108944:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984822528:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789596868.114867:0:11184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596868.114912:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789596868.115464:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984822528 00000100:00100000:1.0:1789596868.115477:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984822528 00000100:00100000:1.0:1789596868.115542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789596868.115551:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11184:x1876527984822528:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789596868.115706:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11184:x1876527984822528:12345-0@lo:1000:mdt00_004.0 Request processed in 156us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596868.115715:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789596868.116132:0:11184:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789596868.116139:0:11184:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d837b7800, transno 4294967316 00000100:00100000:3.0:1789596868.116161:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d820a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984822528:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789596868.116334:0:11184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789596868.116426:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83eeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984822656:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789596868.116473:0:11184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596868.116492:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596868.117118:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984822656 00000100:00100000:1.0:1789596868.117126:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984822656 00000100:00100000:1.0:1789596868.117161:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789596868.117171:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11184:x1876527984822656:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789596868.117310:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11184:x1876527984822656:12345-0@lo:1000:mdt00_004.0 Request processed in 141us (836us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789596868.117318:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789596868.117460:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83eeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11184:1876527984822656:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789596868.117501:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117512:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117519:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117526:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596868.117530:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117538:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117572:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:3.0:1789596868.117576:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596868.117582:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117588:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf655 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117614:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117636:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117642:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117648:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596868.117651:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117658:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117666:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:3.0:1789596868.117669:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596868.117672:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117702:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf58a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117737:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117820:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 22 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117828:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117857:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 22 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.117872:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 22 pid: 11184 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596868.117885:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ee8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984822784:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596868.117953:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596868.121465:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596868.121602:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961695616 00000100:00100000:2.0:1789596868.121612:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961695616 00010000:00010000:2.0:1789596868.121659:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 23 pid: 11184 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596868.121721:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1789596868.121731:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+23:2408:x1876527961695616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596868.121758:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596868.121765:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 23 pid: 11184 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.121777:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 23 pid: 11184 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.121801:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596868.121806:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.121815:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.121823:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.121842:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596868.121909:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+23:2408:x1876527961695616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 179us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596868.121917:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00010000:00010000:2.0:1789596868.121967:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf5a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b60 expref: 22 pid: 11184 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596868.121983:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ee8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984822784:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596868.122017:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122024:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122030:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122041:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122047:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122053:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122058:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596868.122062:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122068:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122085:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596868.122088:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596868.122092:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122097:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf65c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122107:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122112:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122117:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122121:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596868.122123:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122128:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122134:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7d833d8500) 00010000:00010000:2.0:1789596868.122136:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596868.122138:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.122143:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf64e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596868.122344:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596868.122349:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596868.123610:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789596868.124084:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596868.124193:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12369:x1876527961695232:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 39953us (40217us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789596868.124205:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00000020:00080000:2.0:1789596868.124211:0:11184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789596868.129312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596868.129384:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961695872 00000100:00100000:3.0:1789596868.129396:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961695872 00000100:00100000:3.0:1789596868.129483:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:3.0:1789596868.129494:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12369:x1876527961695872:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789596868.129817:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789596868.129851:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789596868.129887:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.129903:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.129934:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.129944:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.129951:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.129958:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.129977:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789596868.130279:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:12369:x1876527961695872:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 784us (975us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789596868.130288:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000020:00080000:3.0:1789596868.130294:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789596868.130856:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596868.130864:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.130873:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596868.130877:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.130887:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.130900:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:3.0:1789596868.130904:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789596868.130920:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.130926:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf663 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596868.130939:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596868.130941:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596868.130943:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596868.540911:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984822912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596868.540989:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596868.541519:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984822912 00000100:00100000:1.0:1789596868.541529:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984822912 00000100:00100000:1.0:1789596868.541576:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789596868.541585:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984822912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596868.541625:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789596868.541714:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984822912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596868.541722:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789596868.541781:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984822912:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789596868.706084:0:14610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789596868.706095:0:14610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596868.706121:0:14610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789596868.706127:0:14610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596868.916945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596868.928017:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961696128 00000100:00100000:1.0:1789596868.928043:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961696128 00000100:00100000:1.0:1789596868.928412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:1.0:1789596868.928424:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:12379:x1876527961696128:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596868.928450:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596868.928472:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf66a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b98 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.928585:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf671 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.928600:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.928614:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596868.928627:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789596868.929330:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf66a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b98 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.929351:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf671 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b98 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596868.929384:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596868.929387:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596868.929390:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0800, rc 0) 00000100:00100000:1.0:1789596868.929455:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12379:x1876527961696128:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1032us (12521us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789596868.929462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:2.0:1789596868.952318:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596868.952359:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961696256 00000100:00100000:2.0:1789596868.952492:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961696256 00000100:00100000:2.0:1789596868.952550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:2.0:1789596868.952560:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12379:x1876527961696256:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1789596868.952638:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953483:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953498:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953518:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953525:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953548:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953625:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953633:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.953640:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596868.954778:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954795:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954801:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954808:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954814:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596868.954819:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954826:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954841:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596868.954851:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596868.954858:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954865:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf67f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954878:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954885:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954891:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954896:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596868.954899:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954905:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954913:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596868.954915:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596868.954918:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954923:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954939:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954951:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954956:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954961:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596868.954964:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954970:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954978:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe300) 00010000:00010000:2.0:1789596868.954981:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596868.954984:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596868.954989:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596868.958241:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12379:x1876527961696256:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 5668us (5919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596868.958258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:3.0:1789596869.037534:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.037663:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961696512 00000100:00100000:2.0:1789596869.037674:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961696512 00000100:00100000:2.0:1789596869.037798:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:2.0:1789596869.037811:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+25:12382:x1876527961696512:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596869.037839:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.037880:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf694 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07b9f expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.037958:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.037973:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.037987:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038001:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038008:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038014:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038140:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038149:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038157:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596869.038166:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789596869.038288:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038306:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038313:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038318:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.038323:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038332:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038344:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596869.038346:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.038351:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038356:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf69b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038369:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038374:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038380:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038385:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.038393:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038399:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038407:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe300) 00010000:00010000:2.0:1789596869.038409:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.038412:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038416:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038457:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf694 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 28 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038470:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 27 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.038477:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.038479:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596869.038481:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc600, rc 0) 00000100:00100000:2.0:1789596869.038544:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12382:x1876527961696512:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 736us (1019us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789596869.038552:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00080000:1.0:1789596869.039049:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596869.047354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596869.047771:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961696640 00000100:00100000:0.0:1789596869.047782:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961696640 00000100:00100000:0.0:1789596869.047838:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:0.0:1789596869.047847:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12382:x1876527961696640:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1789596869.047913:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.047930:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.047956:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.047992:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.047999:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.048006:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.048012:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596869.048016:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.048024:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.048046:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:0.0:1789596869.048048:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596869.048053:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.048060:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bbf6b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596869.048140:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d820a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12382:x1876527961696640:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 293us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596869.048147:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:0.0:1789596869.051773:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.051849:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961696896 00000100:00100000:2.0:1789596869.051859:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961696896 00000100:00100000:2.0:1789596869.051911:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789596869.051920:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12382:x1876527961696896:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789596869.052131:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+28:12382:x1876527961696896:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 211us (367us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789596869.052139:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00010000:00010000:1.0:1789596869.054307:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596869.125617:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.125994:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961697152 00000100:00100000:2.0:1789596869.126005:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961697152 00000100:00100000:2.0:1789596869.126082:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:2.0:1789596869.126094:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+28:11914:x1876527961697152:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596869.126120:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.126144:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf6be lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ba6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.126270:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.126288:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 29 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.126297:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.126329:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 29 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.126343:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 29 pid: 11184 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596869.126357:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e94700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984823040:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596869.126482:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb03999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596869.134164:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.134177:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e94700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876527984823040:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596869.134222:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596869.134351:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961697280 00000100:00100000:3.0:1789596869.134359:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961697280 00010000:00010000:3.0:1789596869.134400:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 30 pid: 11184 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596869.134444:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:3.0:1789596869.134454:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+30:2408:x1876527961697280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596869.134471:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596869.134477:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 30 pid: 11184 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.134489:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 30 pid: 11184 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.134510:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b9f expref: 30 pid: 11184 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.134525:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:3.0:1789596869.134546:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.134555:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.134564:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.134589:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596869.134735:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.134744:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596869.134764:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789596869.134875:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf6be lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.134887:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.134893:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.134895:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596869.134896:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc400, rc 0) 00000100:00100000:2.0:1789596869.134917:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11914:x1876527961697152:12345-192.168.202.16@tcp:101:bash.0 Request processed in 8827us (9313us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789596869.134922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:3.0:1789596869.136535:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:2408:x1876527961697280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2071us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596869.136548:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:0.0:1789596869.138464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596869.138596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961697408 00000100:00100000:3.0:1789596869.138607:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961697408 00000100:00100000:3.0:1789596869.138663:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:3.0:1789596869.138672:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+29:11914:x1876527961697408:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596869.138723:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596869.138749:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf6d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.138826:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf6da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.138842:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.138873:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.138998:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf6d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bad expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.139017:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bad expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.139026:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.139030:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596869.139034:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dda00, rc 0) 00000100:00100000:2.0:1789596869.139285:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11914:x1876527961697408:12345-192.168.202.16@tcp:101:bash.0 Request processed in 612us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.139293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:1.0:1789596869.141860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.141915:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961697664 00000100:00100000:2.0:1789596869.141927:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961697664 00000100:00100000:2.0:1789596869.142000:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 207 00000100:00100000:2.0:1789596869.142010:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+30:11914:x1876527961697664:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:2.0:1789596869.142445:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.142468:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.142480:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596869.142548:0:8967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1789596869.142571:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bf3f0c8 reply state 000000002c55d371 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.142584:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.142591:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.142593:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596869.142597:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789596869.142650:0:8967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789596869.143098:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+34:11914:x1876527961697664:12345-192.168.202.16@tcp:36:bash.0 Request processed in 1086us (1246us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789596869.143108:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 207 00000020:00080000:2.0:1789596869.143113:0:8967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789596869.146405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.146518:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961697792 00000100:00100000:2.0:1789596869.146527:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961697792 00000100:00100000:2.0:1789596869.146574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:2.0:1789596869.146581:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+34:11914:x1876527961697792:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596869.146600:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.146616:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf6e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bb4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.146659:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf6e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bb4 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.146670:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf6e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bb4 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.146732:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.146814:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596869.146818:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc000, rc 0) 00000100:00100000:2.0:1789596869.146865:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+35:11914:x1876527961697792:12345-192.168.202.16@tcp:101:bash.0 Request processed in 284us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.146870:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:0.0:1789596869.151805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.152238:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961697920 00000100:00100000:2.0:1789596869.152249:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961697920 00000100:00100000:2.0:1789596869.152307:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:2.0:1789596869.152317:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:11914:x1876527961697920:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596869.152335:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.152355:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bbb expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596869.152379:0:9893:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aab14c3, atime: 0x6aab14c2, ctime: 0x6aab14c3, blocks: 0x8 00010000:00010000:2.0:1789596869.152400:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789596869.152405:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596869.152412:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 8 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.152428:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 8 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.152440:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc800, rc 0) 00000100:00100000:2.0:1789596869.152497:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:11914:x1876527961697920:12345-192.168.202.16@tcp:101:bash.0 Request processed in 182us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.152518:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:1.0:1789596869.159589:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.159724:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961698048 00000100:00100000:2.0:1789596869.159745:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961698048 00002000:00010000:2.0:1789596869.159788:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789596869.159793:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7eb674c380 with x1876527961698048 ext(0->18446744073709551615) 00002000:00010000:2.0:1789596869.159805:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7eb674c380. 00000100:00100000:2.0:1789596869.159834:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789596869.159844:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961698048:12345-192.168.202.16@tcp:10:bash.0 00002000:00010000:2.0:1789596869.160245:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789596869.160249:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789596867 -> 1789596869 00002000:00010000:2.0:1789596869.160251:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789596866 -> 1789596866 00002000:00010000:2.0:1789596869.160253:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789596867 -> 1789596869 00002000:00010000:2.0:1789596869.160255:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789596869.160319:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961698048:12345-192.168.202.16@tcp:10:bash.0 Request processed in 475us (739us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789596869.160326:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00002000:00010000:2.0:1789596869.160330:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789596869.160332:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7eb674c380 with x1876527961698048 ext(0->18446744073709551615) 00002000:00010000:2.0:1789596869.160336:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7eb674c380. 00000100:00100000:0.0:1789596869.288174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.289667:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961698176 00000100:00100000:2.0:1789596869.289716:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961698176 00000100:00100000:2.0:1789596869.289911:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:2.0:1789596869.289923:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+35:12396:x1876527961698176:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1789596869.290014:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290052:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290066:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290081:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290087:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290093:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290166:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290175:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290181:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596869.290239:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290251:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290257:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290273:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290279:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.290283:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290290:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290302:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596869.290305:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.290891:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290901:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf6f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290918:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290924:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290930:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290935:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.290939:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290959:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290970:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:2.0:1789596869.290972:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.290987:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.290993:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf6fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291010:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291018:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291025:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291031:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.291035:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291042:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291050:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.291054:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.291057:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.291073:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf704 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596869.292615:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+35:12396:x1876527961698176:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 2683us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.292630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:1.0:1789596869.384619:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.390230:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961698432 00000100:00100000:2.0:1789596869.390250:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961698432 00000100:00100000:2.0:1789596869.390347:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:2.0:1789596869.390357:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+35:12399:x1876527961698432:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596869.390380:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.390402:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf70b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bc2 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.390476:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.390491:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.390503:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.390518:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.390524:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.390551:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391000:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391014:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391023:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596869.391036:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789596869.391249:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391258:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391265:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391270:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.391275:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391282:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391294:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596869.391297:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.391323:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391330:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391345:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391352:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391358:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391364:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.391367:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391373:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391381:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:2.0:1789596869.391383:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.391387:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391393:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391439:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf70b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bc2 expref: 38 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391467:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bc2 expref: 37 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.391474:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.391477:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596869.391480:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:2.0:1789596869.391561:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+37:12399:x1876527961698432:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1204us (6954us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789596869.391570:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:1.0:1789596869.397965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596869.398101:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961698560 00000100:00100000:0.0:1789596869.398114:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961698560 00000100:00100000:0.0:1789596869.398183:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:0.0:1789596869.398194:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+37:12399:x1876527961698560:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1789596869.398283:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.398896:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.398910:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.398960:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.398975:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 37 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596869.398992:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984823168:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596869.399089:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596869.404881:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984823168:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596869.404912:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596869.405767:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596869.405850:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961698816 00000100:00100000:3.0:1789596869.405858:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961698816 00000100:00100000:3.0:1789596869.405920:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:3.0:1789596869.405931:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+38:6178:x1876527961698816:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789596869.406304:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:6178:x1876527961698816:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 373us (539us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789596869.406312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789596869.409371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.409475:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961698944 00000100:00100000:2.0:1789596869.409486:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961698944 00010000:00010000:2.0:1789596869.409528:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596869.409572:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:2.0:1789596869.409583:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+39:2409:x1876527961698944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596869.409600:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596869.409607:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.409621:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.409648:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf6c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ba6 expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.409724:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.409741:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.409752:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.409759:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.409785:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596869.409866:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+38:2409:x1876527961698944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 284us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.409874:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00010000:00010000:0.0:1789596869.410005:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410014:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410054:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410061:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410068:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410075:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789596869.410079:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410087:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410097:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:0.0:1789596869.410100:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596869.410103:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.410110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf72e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596869.410151:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+37:12399:x1876527961698560:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 11959us (12200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596869.410167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:1.0:1789596869.417259:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596869.417400:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961699200 00000100:00100000:3.0:1789596869.417412:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961699200 00000100:00100000:3.0:1789596869.417464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789596869.417473:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+37:12399:x1876527961699200:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596869.418166:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+38:12399:x1876527961699200:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 689us (911us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789596869.418175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789596869.550779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.551302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961699456 00000100:00100000:2.0:1789596869.551318:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961699456 00000100:00100000:2.0:1789596869.551390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:2.0:1789596869.551405:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+38:12410:x1876527961699456:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789596869.551431:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.551453:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf735 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bc9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.551527:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.551543:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.551555:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.551586:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.551595:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.551602:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552250:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf74a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552264:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf74a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552273:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf74a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596869.552284:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789596869.552379:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552386:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552392:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552398:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.552402:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552438:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596869.552441:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.552445:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552452:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf73c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552465:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552471:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552476:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552481:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.552483:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552489:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552496:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:2.0:1789596869.552498:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.552501:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552516:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf743 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552567:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf735 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bc9 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552582:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf74a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bc9 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.552590:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.552592:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596869.552595:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:2.0:1789596869.555109:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+40:12410:x1876527961699456:12345-192.168.202.16@tcp:101:cat.0 Request processed in 3696us (4336us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789596869.555122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:3.0:1789596869.565251:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984823296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596869.565358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596869.565937:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984823296 00000100:00100000:2.0:1789596869.565949:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984823296 00000100:00100000:2.0:1789596869.566040:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789596869.566052:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984823296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596869.566092:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789596869.566167:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984823296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.566175:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1789596869.566320:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596869.566370:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984823296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596869.570521:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596869.570550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984823424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596869.570656:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596869.571175:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984823424 00000100:00100000:1.0:1789596869.571189:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984823424 00000100:00100000:1.0:1789596869.571266:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596869.571279:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984823424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596869.571314:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789596869.571388:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984823424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596869.571397:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789596869.571511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984823424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596869.572330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.572406:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961699712 00000100:00100000:2.0:1789596869.572413:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961699712 00000100:00100000:2.0:1789596869.572463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789596869.572473:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+40:12410:x1876527961699712:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789596869.573325:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+41:12410:x1876527961699712:12345-192.168.202.16@tcp:35:cat.0 Request processed in 846us (997us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789596869.573335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:1.0:1789596869.609445:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.609557:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961699968 00000100:00100000:2.0:1789596869.609568:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961699968 00000100:00100000:2.0:1789596869.609630:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:2.0:1789596869.609640:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+41:12411:x1876527961699968:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:2.0:1789596869.609745:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789596869.609777:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf6e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bb4 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609801:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf74a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bc9 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609814:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bc2 expref: 39 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609825:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf6da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bad expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609835:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:2.0:1789596869.609841:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596869.609866:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609900:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609913:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609930:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609936:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.609943:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610165:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610174:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610181:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596869.610474:0:8967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789596869.610486:0:8967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444428806972ns, next at 445428803322ns, rc = 0 00010000:00010000:2.0:1789596869.610541:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610550:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610572:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610580:0:8967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610587:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610593:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610615:0:8967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596869.610637:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610643:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610649:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610655:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.610659:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610666:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.610675:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:0.0:1789596869.610964:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596869.610972:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612332:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789596869.612363:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612373:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf766 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612410:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612416:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612423:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612429:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596869.612433:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612441:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612457:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596869.612460:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596869.612463:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612468:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf758 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596869.612480:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000100bfdba reply state 000000009208ebfd transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612504:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.612512:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:2.0:1789596869.612515:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596869.612519:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596869.612650:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+39:12411:x1876527961699968:12345-192.168.202.16@tcp:36:rm.0 Request processed in 3003us (3209us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789596869.612661:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 213 00010000:00010000:0.0:1789596869.620242:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596869.620261:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.620279:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.620302:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:0.0:1789596869.620306:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789596869.620312:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.620319:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf76d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.620351:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596869.620354:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596869.620356:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596869.678269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596869.678395:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961700224 00000100:00100000:0.0:1789596869.678407:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961700224 00000100:00100000:0.0:1789596869.678481:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:0.0:1789596869.678501:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+39:12417:x1876527961700224:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789596869.678526:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596869.678563:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf774 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bd0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.679121:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.679141:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.679155:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.679167:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.679174:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.679180:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596869.679581:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789596869.683399:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683423:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683436:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683479:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683487:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683493:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683519:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596869.683524:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683531:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683544:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:3.0:1789596869.683547:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596869.683551:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683557:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf77b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596869.683573:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd05c205 reply state 0000000023a868ac transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683584:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683590:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:3.0:1789596869.683593:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789596869.683602:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789596869.683848:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf774 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683864:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.683881:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596869.683883:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596869.683885:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671200, rc 0) 00000100:00100000:3.0:1789596869.683969:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12417:x1876527961700224:12345-192.168.202.16@tcp:101:bash.0 Request processed in 5479us (5711us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789596869.683978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:2.0:1789596869.690218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596869.690305:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961700352 00000100:00100000:3.0:1789596869.690316:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961700352 00000100:00100000:3.0:1789596869.690400:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:3.0:1789596869.690412:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2406:x1876527961700352:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789596869.690434:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596869.690459:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bd7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596869.690496:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789596869.690520:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789596869.690526:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596869.690536:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.690557:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.690572:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671a00, rc 0) 00000100:00100000:3.0:1789596869.690662:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2406:x1876527961700352:12345-192.168.202.16@tcp:101:bash.0 Request processed in 251us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596869.690704:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00080000:0.0:1789596869.692801:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596869.694327:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596869.694433:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961700480 00000100:00100000:1.0:1789596869.694445:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961700480 00000100:00100000:1.0:1789596869.694508:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1789596869.694519:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+8:12417:x1876527961700480:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789596869.694538:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596869.694557:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bde expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.694589:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.694599:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596869.694603:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596869.694619:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.694858:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.694874:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596869.694889:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876527984823552:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596869.695002:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596869.700135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596869.700484:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876527984823552:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596869.700524:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.700548:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0600, rc 0) 00000100:00100000:1.0:1789596869.700624:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:12417:x1876527961700480:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6099us (6299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596869.700632:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789596869.701008:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961700608 00000100:00100000:0.0:1789596869.701019:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961700608 00010000:00010000:0.0:1789596869.701070:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596869.701110:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:0.0:1789596869.701120:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2408:x1876527961700608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596869.701153:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596869.701182:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.701195:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.701228:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb49b774/0x7b5398e289bbf797 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd7 expref: 9 pid: 8435 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.701243:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596869.701247:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596869.701259:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.701270:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.701303:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596869.701318:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876527984823680:192.168.202.16@tcp:105: 00000100:00100000:0.0:1789596869.701398:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596869.709457:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596869.709499:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876527984823680:192.168.202.16@tcp:105: 00010000:00010000:0.0:1789596869.709535:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596869.709564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961700864 00000100:00100000:2.0:1789596869.709572:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961700864 00000100:00100000:0.0:1789596869.709629:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961700608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8508us (9502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596869.709641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:2.0:1789596869.709646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:2.0:1789596869.709660:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+42:12417:x1876527961700864:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:2.0:1789596869.709997:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+43:12417:x1876527961700864:12345-192.168.202.16@tcp:35:bash.0 Request processed in 341us (552us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789596869.710003:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:1.0:1789596869.923509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596869.923775:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961700992 00000100:00100000:0.0:1789596869.923791:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961700992 00000100:00100000:0.0:1789596869.923876:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:0.0:1789596869.923890:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+43:12433:x1876527961700992:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596869.923926:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596869.923956:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf7a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07be5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.924045:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.924063:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.924081:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596869.924144:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789596869.924149:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789596869.924299:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.924331:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf7a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07be5 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.924350:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07be5 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596869.924381:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596869.924384:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596869.924389:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743800, rc 0) 00000100:00100000:0.0:1789596869.924486:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+44:12433:x1876527961700992:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 600us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596869.924493:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:3.0:1789596869.947039:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.947377:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961701248 00000100:00100000:2.0:1789596869.947389:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961701248 00000100:00100000:2.0:1789596869.947462:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 216 00000100:00100000:2.0:1789596869.947473:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+44:12433:x1876527961701248:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596869.947499:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596869.947525:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf7b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bec expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.947767:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf7ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.947810:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.947827:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596869.947842:0:8967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789596869.948000:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf7b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bec expref: 47 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.948025:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf7ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bec expref: 46 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.948035:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:2.0:1789596869.948038:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596869.948042:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:2.0:1789596869.948136:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+46:12433:x1876527961701248:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 664us (1107us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789596869.948146:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 216 00000100:00100000:3.0:1789596869.969916:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596869.970312:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961701376 00000100:00100000:2.0:1789596869.970324:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961701376 00000100:00100000:2.0:1789596869.970396:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:2.0:1789596869.970406:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+46:2406:x1876527961701376:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596869.970422:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596869.970447:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf7ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bec expref: 46 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596869.970489:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:2.0:1789596869.970495:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596869.970557:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+45:2406:x1876527961701376:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 152us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596869.970563:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789596869.983581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596869.983746:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961701632 00000100:00100000:3.0:1789596869.983761:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961701632 00000100:00100000:3.0:1789596869.983830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:3.0:1789596869.983842:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+45:12433:x1876527961701632:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596869.983868:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596869.983887:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf7c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.983993:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf7cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.984008:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf7cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.984021:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf7cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596869.984035:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789596869.984151:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf7c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bf3 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.984169:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf7cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bf3 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596869.984215:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596869.984218:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789596869.984223:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671c00, rc 0) 00000100:00100000:3.0:1789596869.984287:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+47:12433:x1876527961701632:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 447us (718us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789596869.984294:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:3.0:1789596869.992778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596869.992885:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961701760 00000100:00100000:1.0:1789596869.992896:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961701760 00000100:00100000:1.0:1789596869.992958:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789596869.992969:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2406:x1876527961701760:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:1.0:1789596869.993018:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.993038:0:14227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.993049:0:14227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596869.993053:0:14227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596869.993056:0:14227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.993092:0:14227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596869.993128:0:14227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 8 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596869.993143:0:14227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14227:1876527984823808:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596869.993256:0:14227:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596870.002534:0:14227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14227:1876527984823808:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596870.002571:0:14227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596870.004207:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596870.005749:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961701888 00000100:00100000:0.0:1789596870.005772:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961701888 00002000:00100000:0.0:1789596870.005859:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c7e85f09180 x1876527961701888/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:751/0 lens 504/0 e 0 to 0 dl 1789596881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596870.005870:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e85f09180 with x1876527961701888 ext(0->8) 00010000:00010000:0.0:1789596870.005881:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 9 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596870.005905:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 9 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596870.005913:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7e85f09180 00000100:00100000:0.0:1789596870.005962:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1789596870.005974:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961701888:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:0.0:1789596870.007646:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2409:x1876527961701888:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 1652us (3443us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789596870.008155:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00100000:0.0:1789596870.008176:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c7e85f09180 x1876527961701888/t4294967309(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:751/0 lens 504/448 e 0 to 0 dl 1789596881 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596870.008187:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7e85f09180 with x1876527961701888 ext(0->8) 00010000:00010000:0.0:1789596870.008210:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 11 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596870.008228:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 11 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596870.008236:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c7e85f09180 00000100:00100000:1.0:1789596870.012096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.012845:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961702016 00000100:00100000:2.0:1789596870.012861:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961702016 00010000:00010000:2.0:1789596870.012909:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 11 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596870.012966:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:2.0:1789596870.012979:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2408:x1876527961702016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596870.013002:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789596870.013026:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789596870.013030:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789596870 00002000:00010000:2.0:1789596870.013032:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789596870 00002000:00010000:2.0:1789596870.013034:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789596870 00002000:00010000:2.0:1789596870.013036:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789596870.013043:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 11 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.013060:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 11 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.013101:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c0c6385/0x7b5398e289bbf79e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bde expref: 11 pid: 8437 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.013145:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596870.013151:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596870.013157:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.013167:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.013215:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596870.013290:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2408:x1876527961702016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 313us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.013299:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00010000:00010000:1.0:1789596870.013619:0:14227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013632:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013675:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013732:0:14227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013742:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013750:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596870.013756:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013782:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013798:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.013805:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120d6317/0x7b5398e289bbf7dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596870.013888:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2406:x1876527961701760:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 20918us (21120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596870.013897:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:2.0:1789596870.019334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596870.019392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961702272 00000100:00100000:1.0:1789596870.019405:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961702272 00000100:00100000:1.0:1789596870.019602:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:1.0:1789596870.019617:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+47:12433:x1876527961702272:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:1.0:1789596870.019772:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf7cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bf3 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596870.020053:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789596870.020090:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789596870.020714:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789596870.020764:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.020786:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.020816:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.020872:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.020890:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 51 pid: 6519 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596870.020911:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876527984823936:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596870.021639:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596870.027415:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.027531:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961702400 00000100:00100000:3.0:1789596870.027542:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961702400 00010000:00010000:3.0:1789596870.027589:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 52 pid: 6519 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596870.027664:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:3.0:1789596870.027675:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+52:2409:x1876527961702400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596870.027711:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596870.027719:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 52 pid: 6519 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.027742:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 52 pid: 6519 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.027765:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596870.027771:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.027799:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.027807:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.027829:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596870.027894:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+52:2409:x1876527961702400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 221us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.027903:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00010000:00010000:1.0:1789596870.030399:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf789 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bd0 expref: 51 pid: 6519 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596870.030510:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876527984823936:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789596870.030542:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.030554:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.030560:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596870.031137:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789596870.031285:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789596870.032174:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984824064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789596870.032299:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.032499:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836bf480 going to sleep for 11 seconds 00000100:00100000:2.0:1789596870.035082:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824064 00000100:00100000:2.0:1789596870.035103:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824064 00000100:00100000:2.0:1789596870.035264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789596870.035278:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876527984824064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789596870.035527:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876527984824064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 252us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.035535:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789596870.035892:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984824064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789596870.036138:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789596870.036260:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984824192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789596870.036317:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596870.036401:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0540 going to sleep for 11 seconds 00000100:00080000:0.0:1789596870.037442:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596870.038559:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824192 00000100:00100000:2.0:1789596870.038574:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824192 00000100:00100000:2.0:1789596870.038639:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789596870.038659:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876527984824192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789596870.038920:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6523:x1876527984824192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 272us (2604us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789596870.038938:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789596870.039207:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876527984824192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789596870.039283:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789596870.039332:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.039344:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.039353:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.039361:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596870.039366:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.039382:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.039398:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596870.039401:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789596870.039406:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.039413:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bbf7e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596870.039521:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789596870.039586:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789596870.039597:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444857918249ns, next at 445857915710ns, rc = 0 00000001:00080000:3.0:1789596870.039604:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789596870.039630:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596870.039633:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789596870.039640:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf7cf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bf3 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596870.039856:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+54:12433:x1876527961702272:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 20243us (20533us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789596870.039865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000020:00080000:3.0:1789596870.039869:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789596870.051051:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596870.051187:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961702528 00000100:00100000:0.0:1789596870.051208:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961702528 00000100:00100000:0.0:1789596870.051280:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 218 00000100:00100000:0.0:1789596870.051293:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+54:12433:x1876527961702528:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596870.051327:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596870.051356:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf7eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07bfa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596870.051425:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf7eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bfa expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596870.051440:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf7eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bfa expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596870.051484:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:0.0:1789596870.051487:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596870.051491:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743200, rc 0) 00000100:00100000:0.0:1789596870.051572:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+55:12433:x1876527961702528:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 282us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596870.051581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 218 00000100:00100000:2.0:1789596870.063038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.063277:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961702784 00000100:00100000:3.0:1789596870.063292:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961702784 00000100:00100000:3.0:1789596870.063373:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1789596870.063384:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+55:12433:x1876527961702784:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596870.064249:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12433:x1876527961702784:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 858us (1219us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789596870.064259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00010000:00010000:3.0:1789596870.077317:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596870.081218:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984824448:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.081339:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596870.081412:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984824960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.081435:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596870.081458:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984825472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.081500:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596870.081535:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789596870.081542:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984824576:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.081573:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596870.081591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984825088:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.081614:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.081798:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984824704:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.081836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.081867:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984825216:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.081899:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.081916:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789596870.081922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984824320:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.081947:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.081969:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984824832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.081993:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.082009:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984825344:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.082028:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596870.082053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824320 00000100:00100000:1.0:1789596870.082062:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824320 00000100:00100000:1.0:1789596870.082115:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789596870.082124:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984824320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.082169:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984824320:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596870.082176:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789596870.082222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824576 00000100:00100000:1.0:1789596870.082225:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824576 00000100:00100000:1.0:1789596870.082240:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824832 00000100:00100000:1.0:1789596870.082243:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824832 00000100:00100000:1.0:1789596870.082254:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789596870.082260:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984824576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596870.082376:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824448 00000100:00100000:2.0:1789596870.082381:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824448 00000100:00100000:2.0:1789596870.082403:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824960 00000100:00100000:2.0:1789596870.082406:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824960 00000100:00080000:2.0:1789596870.082425:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596870.082442:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984825088 00000100:00100000:2.0:1789596870.082444:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984825088 00000100:00080000:2.0:1789596870.082454:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596870.082465:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984824704 00000100:00100000:2.0:1789596870.082468:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984824704 00000100:00100000:2.0:1789596870.082479:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984825216 00000100:00100000:2.0:1789596870.082481:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984825216 00000100:00080000:2.0:1789596870.082494:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596870.082506:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789596870.082512:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984824448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596870.095155:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984825344 00000100:00100000:0.0:1789596870.095176:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984825344 00000100:00100000:0.0:1789596870.095311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789596870.095327:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984824960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.111212:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984825472 00000100:00100000:3.0:1789596870.111231:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984825472 00000100:00100000:3.0:1789596870.111299:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789596870.111310:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984825472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.115562:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984824576:12345-0@lo:400:kworker.0 Request processed in 33286us (33973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596870.115583:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789596870.115639:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789596870.117005:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984824832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.117122:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984824832:12345-0@lo:400:kworker.0 Request processed in 1474us (35127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596870.117130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789596870.117234:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984824320:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.117252:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984824832:0@lo:400:kworker.0 00000100:00080000:1.0:1789596870.117339:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596870.117348:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596870.117482:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984824448:12345-0@lo:400:kworker.0 Request processed in 34967us (36142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.117491:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789596870.117519:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789596870.117530:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984825088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596870.117567:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984825088:12345-0@lo:400:kworker.0 Request processed in 42us (35953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.117572:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789596870.117607:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789596870.117614:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984824704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596870.118959:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984824704:12345-0@lo:400:kworker.0 Request processed in 1338us (37116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.118981:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789596870.119021:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789596870.119035:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb459d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984825216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596870.119102:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb459d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984825216:12345-0@lo:400:kworker.0 Request processed in 74us (37202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.119108:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789596870.119121:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789596870.119128:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984825344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596870.119159:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984825344:12345-0@lo:400:kworker.0 Request processed in 32us (37130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.119165:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789596870.119398:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984824960:12345-0@lo:400:kworker.0 Request processed in 24074us (37959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596870.119407:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789596870.128065:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984825472:12345-0@lo:400:kworker.0 Request processed in 16412us (46219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.128087:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789596870.128268:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984825600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596870.128361:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596870.128476:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984824576:0@lo:400:kworker.0 00010000:00080000:3.0:1789596870.128497:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83efb100 x1876527984825088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596870.128508:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984825088:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.128521:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984824448:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.128532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984824960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.128544:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984825472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.132862:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984825728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596870.132947:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789596870.133945:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d837b7100 x1876527984825344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596870.133966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984825344:0@lo:400:kworker.0 00000100:00100000:0.0:1789596870.134125:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984825600 00000100:00100000:0.0:1789596870.134136:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984825600 00000100:00100000:0.0:1789596870.134225:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984825728 00000100:00100000:0.0:1789596870.134229:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984825728 00000100:00100000:0.0:1789596870.134251:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789596870.134262:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1876527984825600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596870.134293:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596870.134361:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1876527984825600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (5999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596870.134368:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789596870.134386:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789596870.134392:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984825728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596870.134424:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596870.134450:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984825728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596870.134455:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789596870.134500:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984825600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596870.134586:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984824704:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.134598:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984825216:0@lo:400:kworker.0 00000100:00100000:3.0:1789596870.134643:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984825728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596870.200600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.200751:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961702912 00000100:00100000:2.0:1789596870.200766:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961702912 00000100:00100000:2.0:1789596870.200852:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:2.0:1789596870.200866:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12443:x1876527961702912:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1789596870.200958:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201043:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201060:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201094:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201103:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201111:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201190:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201213:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201221:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596870.201278:0:8967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201293:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201299:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201307:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201314:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596870.201319:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201336:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201350:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596870.201353:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596870.201358:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201364:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf7f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201380:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201385:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201391:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201396:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596870.201399:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201404:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201411:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:2.0:1789596870.201414:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596870.201417:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201433:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf7f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201444:0:8967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201450:0:8967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201455:0:8967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201460:0:8967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596870.201463:0:8967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201469:0:8967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201477:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.201479:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596870.201482:0:8967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.201489:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596870.201588:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12443:x1876527961702912:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 724us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.201597:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:2.0:1789596870.299477:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.299573:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961703168 00000100:00100000:3.0:1789596870.299585:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961703168 00000100:00100000:3.0:1789596870.299656:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:3.0:1789596870.299667:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+56:12446:x1876527961703168:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596870.301029:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596870.301069:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf807 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c01 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302446:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302477:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302492:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302506:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302513:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302520:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302696:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf81c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302705:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.302713:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596870.303276:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789596870.303395:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303404:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303410:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303416:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596870.303421:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303428:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303441:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596870.303444:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596870.303451:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303458:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf80e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303472:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303478:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303484:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303502:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596870.303505:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303511:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303518:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:2.0:1789596870.303520:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596870.303523:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303528:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf815 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303575:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf807 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c01 expref: 59 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303589:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c01 expref: 58 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.303595:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.303597:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596870.303600:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:2.0:1789596870.306923:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12446:x1876527961703168:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 7237us (7436us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789596870.306943:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:1.0:1789596870.307296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.309936:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961703296 00000100:00100000:3.0:1789596870.309953:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961703296 00000100:00100000:3.0:1789596870.310115:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:3.0:1789596870.310126:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12446:x1876527961703296:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789596870.310206:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310226:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310239:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310276:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310284:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310291:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310297:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596870.310302:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310311:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310322:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:3.0:1789596870.310325:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596870.310330:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.310348:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf82a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596870.311229:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12446:x1876527961703296:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 1095us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.311243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:1.0:1789596870.314494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.314634:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961703552 00000100:00100000:3.0:1789596870.314645:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961703552 00000100:00100000:3.0:1789596870.314727:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789596870.314738:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+58:12446:x1876527961703552:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789596870.315176:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+59:12446:x1876527961703552:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 438us (701us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789596870.315184:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1789596870.441013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.441112:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961703808 00000100:00100000:2.0:1789596870.441144:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961703808 00000100:00100000:2.0:1789596870.441254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:2.0:1789596870.441266:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+59:12456:x1876527961703808:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596870.441300:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596870.441304:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789596870.441338:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743800/0x7b5398e289bbf7ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07be5 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.441362:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596870.441369:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596870.441384:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf831 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c08 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.441520:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.441536:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.441546:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596870.441557:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789596870.441998:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf831 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c08 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.442019:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c08 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.442027:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.442042:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596870.442046:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:2.0:1789596870.442114:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+60:12456:x1876527961703808:12345-192.168.202.16@tcp:101:bash.0 Request processed in 851us (1113us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789596870.442122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:1.0:1789596870.447217:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.447894:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961703936 00000100:00100000:2.0:1789596870.447913:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961703936 00000100:00100000:2.0:1789596870.448007:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789596870.448019:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+60:2406:x1876527961703936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596870.448039:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596870.448070:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c08 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.448091:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.448097:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596870.448168:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+59:2406:x1876527961703936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 151us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.448176:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789596870.454358:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.454551:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961704064 00000100:00100000:2.0:1789596870.454565:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961704064 00000100:00100000:2.0:1789596870.454644:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:2.0:1789596870.454656:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+59:12456:x1876527961704064:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596870.454716:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596870.454747:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf846 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c0f expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.454786:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.454819:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.454833:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.454958:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf846 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 61 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.455213:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 60 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.455223:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.455226:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596870.455229:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98daa00, rc 0) 00000100:00100000:2.0:1789596870.456341:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+60:12456:x1876527961704064:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1679us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.456352:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:0.0:1789596870.460901:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.461144:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961704320 00000100:00100000:2.0:1789596870.461155:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961704320 00000100:00100000:2.0:1789596870.461237:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 224 00000100:00100000:2.0:1789596870.461247:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+60:12456:x1876527961704320:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:2.0:1789596870.461317:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596870.461350:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf81c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c01 expref: 60 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.461372:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.461408:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596870.461622:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.461643:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.461655:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596870.461747:0:8967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789596870.461773:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ce48a73 reply state 000000003a3a98c4 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.461788:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.461795:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.461798:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789596870.461801:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596870.461917:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+62:12456:x1876527961704320:12345-192.168.202.16@tcp:36:bash.0 Request processed in 669us (1028us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789596870.461925:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 224 00000020:00080000:2.0:1789596870.461931:0:8967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789596870.466987:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.467154:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961704448 00000100:00100000:2.0:1789596870.467168:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961704448 00000100:00100000:2.0:1789596870.467252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 225 00000100:00100000:2.0:1789596870.467262:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+62:12456:x1876527961704448:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789596870.467289:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596870.467311:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf85b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c16 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.467432:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.467555:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.467570:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596870.467602:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789596870.467606:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596870.468019:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.468053:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf85b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.468072:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.468082:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596870.468085:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596870.468089:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:2.0:1789596870.468164:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12456:x1876527961704448:12345-192.168.202.16@tcp:101:bash.0 Request processed in 902us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.468171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 225 00000100:00100000:1.0:1789596870.474181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.474364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961704704 00000100:00100000:3.0:1789596870.474376:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961704704 00000100:00100000:3.0:1789596870.474458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789596870.474472:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+63:12456:x1876527961704704:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:3.0:1789596870.474878:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12456:x1876527961704704:12345-192.168.202.16@tcp:35:bash.0 Request processed in 406us (711us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789596870.474888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789596870.583189:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.583357:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961704832 00000100:00100000:2.0:1789596870.583369:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961704832 00000100:00100000:2.0:1789596870.583461:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 226 00000100:00100000:2.0:1789596870.583473:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+64:12462:x1876527961704832:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789596870.583501:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596870.583530:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c1d expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.583607:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.583622:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.583635:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596870.583795:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789596870.583799:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596870.583826:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.583857:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c1d expref: 66 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.583881:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c1d expref: 65 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596870.583892:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596870.583895:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596870.583900:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:2.0:1789596870.584387:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961704832:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 914us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.584407:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 226 00000100:00100000:1.0:1789596870.594290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.595270:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961704960 00000100:00100000:3.0:1789596870.595286:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961704960 00000100:00100000:3.0:1789596870.595477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 227 00000100:00100000:3.0:1789596870.595491:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961704960:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596870.595515:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596870.595553:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c24 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595647:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595665:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595706:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595727:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595736:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595743:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595838:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595850:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.595858:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596870.595915:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789596870.595920:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789596870.595944:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596150:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596161:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596167:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596173:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596179:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596870.596183:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596266:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596286:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:3.0:1789596870.596290:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596870.596297:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf87e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596320:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596326:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596340:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596346:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596870.596349:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596356:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596364:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:3.0:1789596870.596367:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596870.596370:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596376:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf885 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596409:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf877 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c24 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596423:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c24 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.596431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:3.0:1789596870.596433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596870.596436:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671200, rc 0) 00000100:00100000:3.0:1789596870.596525:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12462:x1876527961704960:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1036us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.596543:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 227 00000100:00100000:2.0:1789596870.603076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596870.603154:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596870.603421:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961705344 00000100:00100000:0.0:1789596870.603432:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961705344 00000100:00100000:0.0:1789596870.603501:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789596870.603513:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+66:2406:x1876527961705344:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596870.603528:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596870.603554:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671200/0x7b5398e289bbf88c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c24 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596870.603575:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:0.0:1789596870.603580:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596870.603654:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+65:2406:x1876527961705344:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 143us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596870.603662:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789596870.605558:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961705216 00000100:00100000:3.0:1789596870.605575:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961705216 00000100:00100000:1.0:1789596870.605909:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 228 00000100:00100000:1.0:1789596870.605921:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961705216:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789596870.605941:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596870.605961:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf893 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c2b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.606112:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.606128:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.606136:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.606170:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.606183:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 66 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596870.606366:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984825856:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789596870.606465:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dda180 going to sleep for 11 seconds 00000100:00100000:3.0:1789596870.610914:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876527984825856:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596870.610947:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596870.613783:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.614033:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961705472 00000100:00100000:3.0:1789596870.614062:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961705472 00010000:00010000:3.0:1789596870.614127:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 67 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596870.614167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:3.0:1789596870.614178:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+67:2408:x1876527961705472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596870.614219:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596870.614228:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 67 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.614244:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 67 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.614275:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf862 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c16 expref: 67 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.614292:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:3.0:1789596870.614299:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.614334:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.614344:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.614370:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596870.614452:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+66:2408:x1876527961705472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 274us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.614461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00010000:00010000:1.0:1789596870.615953:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.615977:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596870.616003:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789596870.616166:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf893 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.616219:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.616228:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:1.0:1789596870.616231:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596870.616234:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0200, rc 0) 00000100:00100000:1.0:1789596870.616340:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12462:x1876527961705216:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 10420us (13276us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789596870.616348:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 228 00000100:00100000:1.0:1789596870.624525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.624893:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961705728 00000100:00100000:3.0:1789596870.624906:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961705728 00000100:00100000:1.0:1789596870.625327:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1789596870.625339:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12462:x1876527961705728:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:1.0:1789596870.625360:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596870.625383:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf7eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bfa expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596870.625419:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:1.0:1789596870.625426:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596870.625506:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961705728:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 170us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596870.625514:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789596870.628841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.629022:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961705856 00000100:00100000:3.0:1789596870.629035:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961705856 00000100:00100000:3.0:1789596870.629124:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:3.0:1789596870.629135:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961705856:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:3.0:1789596870.629332:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.629358:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.629372:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596870.629526:0:8967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789596870.629607:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961705856:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 473us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.629616:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:0.0:1789596870.634970:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596870.635599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961705984 00000100:00100000:3.0:1789596870.635612:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961705984 00000100:00100000:3.0:1789596870.635726:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 230 00000100:00100000:3.0:1789596870.635741:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+65:12462:x1876527961705984:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789596870.635765:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596870.635787:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c32 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.635858:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.635869:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.635894:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.635909:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.635925:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:3.0:1789596870.635928:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596870.635933:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596870.635940:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671400, rc 0) 00000100:00100000:3.0:1789596870.636028:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12462:x1876527961705984:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 290us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596870.636036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 230 00010000:00010000:1.0:1789596871.102133:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789596871.118662:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789596871.118870:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:2.0:1789596871.229240:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596871.229257:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596871.229294:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789596871.229307:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596871.229493:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84451880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984825984:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789596871.229636:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596871.237732:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84451880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984825984:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596871.245031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596871.245118:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961706112 00000100:00100000:1.0:1789596871.245148:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961706112 00000100:00100000:1.0:1789596871.245321:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:1.0:1789596871.245333:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12463:x1876527961706112:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596871.245389:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596871.245514:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12463:x1876527961706112:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 182us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.245522:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00080000:2.0:1789596871.247319:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596871.250813:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.251145:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961706240 00000100:00100000:2.0:1789596871.251159:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961706240 00000100:00100000:2.0:1789596871.251256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:2.0:1789596871.251269:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12463:x1876527961706240:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789596871.251368:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251398:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251413:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251433:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251441:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251464:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251493:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251504:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251511:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596871.251563:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789596871.251568:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596871.251584:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251597:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251604:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251612:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251619:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.251625:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251635:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251670:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:2.0:1789596871.251673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596871.251705:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251713:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da800/0x7b5398e289bbf8b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251729:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251736:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251742:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251747:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.251750:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251756:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251764:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9c7e84ffeb00) 00010000:00010000:2.0:1789596871.251767:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596871.251770:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db000/0x7b5398e289bbf8bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251804:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251809:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251815:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251820:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.251823:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251828:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251835:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596871.251837:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596871.251840:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.251845:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf8c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.251931:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12463:x1876527961706240:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 664us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.251939:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:0.0:1789596871.256092:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.256218:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961706496 00000100:00100000:2.0:1789596871.256234:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961706496 00000100:00100000:2.0:1789596871.256318:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:2.0:1789596871.256338:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+66:12463:x1876527961706496:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596871.256375:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596871.256408:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf8cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c39 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256544:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256562:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256575:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596871.256586:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789596871.256666:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256673:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256716:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256722:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.256727:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256735:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256746:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596871.256754:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596871.256760:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256767:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256875:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf8cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c39 expref: 68 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256886:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:2.0:1789596871.256888:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596871.256893:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf8cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c39 expref: 68 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.256903:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc000, rc 0) 00000100:00100000:2.0:1789596871.256973:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12463:x1876527961706496:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 638us (906us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789596871.256981:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:1.0:1789596871.263875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.264083:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961706624 00000100:00100000:3.0:1789596871.264098:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961706624 00000100:00100000:3.0:1789596871.264245:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:3.0:1789596871.264256:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12463:x1876527961706624:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596871.264318:0:8967:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596871.264505:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12463:x1876527961706624:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 250us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.264514:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:0.0:1789596871.271625:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.272324:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961706880 00000100:00100000:2.0:1789596871.272339:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961706880 00000100:00100000:2.0:1789596871.272719:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:2.0:1789596871.272734:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12463:x1876527961706880:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596871.272761:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596871.272764:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789596871.272996:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbc00/0x7b5398e289bbf870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c1d expref: 67 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.273021:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:2.0:1789596871.273043:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596871.273059:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf8e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c40 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596871.274307:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789596871.274494:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.274510:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.274523:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.274581:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf8e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c40 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.274599:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c40 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.274607:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7e84ffeb00) 00010000:00010000:2.0:1789596871.274610:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596871.274613:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc400, rc 0) 00000100:00100000:2.0:1789596871.274726:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+68:12463:x1876527961706880:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1994us (3114us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789596871.274733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:1.0:1789596871.279303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.279573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961707136 00000100:00100000:3.0:1789596871.279585:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961707136 00000100:00100000:3.0:1789596871.279664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:3.0:1789596871.279705:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+68:12463:x1876527961707136:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596871.279949:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596871.279980:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf8e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c40 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280004:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7e84ffeb00) 00010000:00010000:3.0:1789596871.280015:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596871.280037:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280051:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280062:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280088:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280112:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280119:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280172:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280181:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280202:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280208:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81670e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596871.280213:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280221:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280230:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:3.0:1789596871.280233:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596871.280237:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280243:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf8f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280254:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280267:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280273:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280279:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789596871.280282:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280289:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280297:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x74c6d3d8 (ffff9c7d825db200) 00010000:00010000:3.0:1789596871.280299:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596871.280302:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.280308:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf8fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x74c6d3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.280916:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12463:x1876527961707136:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1237us (1625us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596871.280925:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:1.0:1789596871.289299:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.289543:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961707264 00000100:00100000:3.0:1789596871.289553:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961707264 00000100:00100000:3.0:1789596871.289627:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 237 00000100:00100000:3.0:1789596871.289639:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+67:12463:x1876527961707264:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596871.289673:0:8967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596871.289754:0:8967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf903 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c47 expref: -99 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.291142:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.291172:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.291292:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.291573:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671a00/0x7b5398e289bbf903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 69 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.291596:0:8967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 68 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.291605:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:0.0:1789596871.291608:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789596871.291612:0:8967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596871.291738:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+68:12463:x1876527961707264:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2100us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596871.291746:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 237 00000100:00100000:2.0:1789596871.299339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.300498:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961707520 00000100:00100000:0.0:1789596871.300509:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961707520 00000100:00100000:0.0:1789596871.300578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:0.0:1789596871.300588:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+68:12463:x1876527961707520:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596871.300727:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.300766:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.301562:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596871.301931:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789596871.301941:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446120261339ns, next at 447120258799ns, rc = 0 00000004:00010000:0.0:1789596871.302056:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b7a4aaf reply state 000000002ec307e1 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.302132:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.302143:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:0.0:1789596871.302146:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789596871.302150:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596871.302638:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+70:12463:x1876527961707520:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 2047us (3308us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789596871.302656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:1.0:1789596871.308373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.309311:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961707648 00000100:00100000:3.0:1789596871.309327:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961707648 00000100:00100000:3.0:1789596871.309612:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:3.0:1789596871.309626:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+70:12463:x1876527961707648:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596871.309667:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596871.309739:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c4e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.309813:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.309829:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.309849:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596871.309852:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596871.309857:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81670e00, rc 0) 00000100:00100000:3.0:1789596871.309932:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+71:12463:x1876527961707648:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 310us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.309941:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:1.0:1789596871.315244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.315464:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961707776 00000100:00100000:0.0:1789596871.315475:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961707776 00000100:00100000:0.0:1789596871.315555:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789596871.315567:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2407:x1876527961707776:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789596871.315844:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2407:x1876527961707776:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 279us (611us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789596871.315852:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00080000:2.0:1789596871.316538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596871.324459:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.325028:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961708032 00000100:00100000:3.0:1789596871.325044:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961708032 00000100:00100000:3.0:1789596871.325119:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789596871.325131:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+71:12463:x1876527961708032:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789596871.325433:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+72:12463:x1876527961708032:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 303us (983us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789596871.325441:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789596871.330747:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.330814:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961708288 00000100:00100000:0.0:1789596871.330845:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961708288 00000100:00100000:0.0:1789596871.330974:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:0.0:1789596871.330987:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+72:12463:x1876527961708288:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789596871.331143:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+72:12463:x1876527961708288:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 160us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596871.331152:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:1.0:1789596871.336066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.336402:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961708416 00000100:00100000:2.0:1789596871.336413:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961708416 00000100:00100000:2.0:1789596871.336473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:2.0:1789596871.336483:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+72:12463:x1876527961708416:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596871.336502:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596871.336522:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf91f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c55 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.336589:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.336605:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.336617:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596871.336665:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596871.336731:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.336762:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc200/0x7b5398e289bbf91f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c55 expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.336782:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c55 expref: 73 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.336792:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:2.0:1789596871.336795:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596871.336798:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc600, rc 0) 00000100:00100000:2.0:1789596871.336885:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+73:12463:x1876527961708416:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 403us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.336892:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:2.0:1789596871.344803:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596871.344919:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961708544 00000100:00100000:1.0:1789596871.344929:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961708544 00000100:00100000:1.0:1789596871.345172:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:1.0:1789596871.345197:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+10:2408:x1876527961708544:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596871.345222:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596871.345250:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c5c expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596871.345281:0:14227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab14c7, blocks: 0x0 00010000:00010000:1.0:1789596871.345311:0:14227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789596871.345315:0:14227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596871.345326:0:14227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 11 pid: 14227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.345605:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 11 pid: 14227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.345624:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0600, rc 0) 00000100:00100000:1.0:1789596871.346104:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2408:x1876527961708544:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 920us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.346122:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:1.0:1789596871.353327:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.353599:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961708800 00000100:00100000:0.0:1789596871.353610:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961708800 00000100:00100000:0.0:1789596871.353745:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:0.0:1789596871.353757:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+73:12463:x1876527961708800:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789596871.353875:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+73:12463:x1876527961708800:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 121us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596871.353884:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:0.0:1789596871.359424:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.359519:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961708928 00000100:00100000:3.0:1789596871.359530:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961708928 00000100:00100000:3.0:1789596871.359591:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:3.0:1789596871.359601:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+11:12463:x1876527961708928:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596871.359620:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596871.359640:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c63 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.359674:0:9893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 12 pid: 14227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.359726:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596871.359731:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596871.359738:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 12 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.359772:0:9893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 12 pid: 14227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.359787:0:9893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 12 pid: 14227 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.359824:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984826112:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596871.359928:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596871.365439:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.365645:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709056 00000100:00100000:0.0:1789596871.365656:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709056 00010000:00010000:0.0:1789596871.365747:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 13 pid: 14227 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.365793:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:0.0:1789596871.365805:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2409:x1876527961709056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596871.365825:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596871.365854:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 13 pid: 14227 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.365895:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 13 pid: 14227 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.365932:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596871.365936:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596871.365945:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 13 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.365956:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 13 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.366004:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 13 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.366020:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876527984826240:192.168.202.16@tcp:105: 00000100:00100000:0.0:1789596871.366121:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5180 going to sleep for 11 seconds 00010000:00010000:3.0:1789596871.366587:0:9893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bbf92d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c5c expref: 13 pid: 14227 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.366604:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984826112:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789596871.366627:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 12 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.366637:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81671a00, rc 0) 00000100:00100000:3.0:1789596871.366669:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+12:12463:x1876527961708928:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 7068us (7257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.366729:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1789596871.372951:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876527984826240:192.168.202.16@tcp:105: 00010000:00010000:0.0:1789596871.372988:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596871.373105:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2409:x1876527961709056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7300us (7675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596871.373116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:2.0:1789596871.377622:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.378925:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709184 00000100:00100000:0.0:1789596871.378947:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709184 00002000:00100000:0.0:1789596871.379044:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9c7d84453800 x1876527961709184/t0(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:752/0 lens 504/0 e 0 to 0 dl 1789596882 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596871.379260:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d84453800 with x1876527961709184 ext(0->12) 00002000:00010000:0.0:1789596871.379270:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d84453800 00000100:00100000:0.0:1789596871.379326:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789596871.379340:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+11:2409:x1876527961709184:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789596871.382613:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2409:x1876527961709184:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 3264us (4991us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789596871.382627:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00002000:00100000:0.0:1789596871.382640:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9c7d84453800 x1876527961709184/t4294967321(0) o4->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:752/0 lens 504/448 e 0 to 0 dl 1789596882 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596871.382650:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d84453800 with x1876527961709184 ext(0->12) 00002000:00010000:0.0:1789596871.382657:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d84453800 00000100:00100000:1.0:1789596871.387592:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.387811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709312 00000100:00100000:2.0:1789596871.387822:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709312 00000100:00100000:2.0:1789596871.387927:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:2.0:1789596871.387940:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+73:12463:x1876527961709312:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789596871.391519:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789596871.391539:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:2.0:1789596871.391731:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+71:12463:x1876527961709312:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 3788us (4142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.391744:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 243 00000004:00080000:0.0:1789596871.391954:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789596871.391984:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7d825b06c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789596871.391989:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d83d57700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d825b0600 00000020:00080000:0.0:1789596871.391992:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d83d57600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d83183800 00000004:00080000:0.0:1789596871.392022:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:1.0:1789596871.392077:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392090:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392098:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392105:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.392110:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392118:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392134:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c7d825db300) 00010000:00010000:1.0:1789596871.392138:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.392159:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392166:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bbf639 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392211:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392219:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392224:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392229:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dce00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.392233:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392238:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392246:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c7e84ffe000) 00010000:00010000:1.0:1789596871.392249:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.392252:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392257:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dce00/0x7b5398e289bbf6e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392273:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392279:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392291:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392296:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.392299:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392306:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392315:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:1.0:1789596871.392318:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.392321:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392328:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bbf75f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392341:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392357:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392363:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392369:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.392372:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392399:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392408:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7e84ffe200) 00010000:00010000:1.0:1789596871.392410:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.392413:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392419:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742400/0x7b5398e289bbf782 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392436:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392442:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392447:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392452:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.392455:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392461:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392469:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:1.0:1789596871.392471:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.392474:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392489:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bbf854 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392503:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392510:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392517:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392522:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.392526:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392531:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392539:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:1.0:1789596871.392542:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789596871.392545:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.392550:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bbf911 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596871.393578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984826368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789596871.393647:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596871.393796:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984826368 00000100:00100000:1.0:1789596871.393818:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984826368 00000100:00100000:1.0:1789596871.393873:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789596871.393882:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984826368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789596871.393912:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1789596871.393947:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aab14c6, atime: 0x6aab14c6, ctime: 0x6aab14c6, blocks: 0x8 00010000:00010000:1.0:1789596871.393955:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.393981:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789596871.393985:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596871.393992:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.394009:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.394019:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.394026:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.394045:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789596871.395314:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984826368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1428us (1662us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789596871.395325:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789596871.395882:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596871.395908:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.395922:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596871.395927:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.395938:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.395960:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.396265:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000079f176d/0x7b5398e289bbf93b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.396289:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596871.396291:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596871.396293:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596871.396334:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789596871.396341:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:1.0:1789596871.396374:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d837b8380, transno 4294967308 00000004:00080000:1.0:1789596871.397693:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:1.0:1789596871.398535:0:3647:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c7d84451500 x1876527984826368/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789596887 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789596871.398554:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d84451500/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789596871.398560:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984826368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789596871.398850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984826496:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789596871.398933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596871.398993:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596871.399000:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984826624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789596871.399034:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596871.399083:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984826496 00000100:00100000:3.0:1789596871.399093:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984826496 00000100:00100000:3.0:1789596871.399147:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984826624 00000100:00100000:3.0:1789596871.399150:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984826624 00000100:00100000:3.0:1789596871.399169:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596871.399178:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876527984826496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789596871.399908:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1789596871.399942:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.399965:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 12 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.399974:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789596871.399979:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596871.399983:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.400015:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 12 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.400032:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 12 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.400045:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984826752:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596871.400141:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596871.400173:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789596871.400338:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876527984826624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789596871.400655:0:9893:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789596871.400659:0:9893:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789596871 00002000:00010000:3.0:1789596871.400661:0:9893:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789596871.400663:0:9893:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789596871 -> 1789596871 00002000:00010000:3.0:1789596871.400674:0:9893:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789596871.400771:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1876527984826624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 590us (1735us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789596871.400779:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1789596871.400835:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d83ded180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789596871.400841:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984826624:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789596871.400890:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1789596871.408868:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7d825b0900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789596871.408883:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d844de900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d825b0480 00000020:00080000:0.0:1789596871.408886:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7d844def00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7d836fca00 00000020:00080000:0.0:1789596871.408902:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789596871.409032:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789596871.409296:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789596871.410895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596871.410996:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.411730:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709568 00000100:00100000:2.0:1789596871.411742:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709568 00010000:00010000:2.0:1789596871.411795:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 13 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.411847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:2.0:1789596871.411860:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2408:x1876527961709568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596871.411879:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596871.411886:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 13 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.411902:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 13 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.411971:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596871.411977:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596871.411985:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.411996:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.412020:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596871.412098:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2408:x1876527961709568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 241us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.412107:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:2.0:1789596871.412140:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709440 00000100:00100000:2.0:1789596871.412144:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709440 00000100:00100000:2.0:1789596871.412173:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:2.0:1789596871.412179:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+13:2406:x1876527961709440:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789596871.415956:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbf6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07bbb expref: 13 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.415990:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876527984826752:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596871.416021:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.416035:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.416044:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.416058:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.416077:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.416111:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789596871.417561:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596871.417576:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.417589:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596871.417595:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.417604:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.417628:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.417635:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071360e1b/0x7b5398e289bbf942 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.417655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596871.417657:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596871.417659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596871.420039:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1876527984826496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20855us (21099us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789596871.420052:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1789596871.421373:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7d83ded880/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789596871.421528:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984826496:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789596871.429916:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1789596871.429934:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789596871.430738:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2406:x1876527961709440:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 18548us (19851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.430750:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:1.0:1789596871.437673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.437893:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709824 00000100:00100000:0.0:1789596871.437920:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709824 00000100:00100000:0.0:1789596871.438097:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:0.0:1789596871.438108:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12463:x1876527961709824:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596871.438172:0:8967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596871.438280:0:8967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c55 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.438301:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:0.0:1789596871.438308:0:8967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596871.438342:0:8967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.438368:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.438388:0:8967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596871.438525:0:8967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003785401b reply state 00000000c5cc2679 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.438538:0:8967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.438544:0:8967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:0.0:1789596871.438547:0:8967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789596871.438550:0:8967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596871.443641:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+22:12463:x1876527961709824:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 5516us (6002us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789596871.443659:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:2.0:1789596871.448952:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.449264:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961709952 00000100:00100000:3.0:1789596871.449279:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961709952 00000100:00100000:3.0:1789596871.449571:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:3.0:1789596871.449583:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961709952:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789596871.450179:0:14227:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789596871.450260:0:14227:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789596871 -> 1789596871 00002000:00010000:2.0:1789596871.450279:0:14227:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789596870 00002000:00010000:2.0:1789596871.450281:0:14227:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789596871 -> 1789596871 00002000:00010000:2.0:1789596871.450284:0:14227:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789596871.450570:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2408:x1876527961709952:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 985us (1626us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789596871.450580:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:2.0:1789596871.455838:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.456137:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961710208 00000100:00100000:3.0:1789596871.456149:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961710208 00000100:00100000:3.0:1789596871.456256:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:3.0:1789596871.456268:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+22:12463:x1876527961710208:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789596871.456357:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.456385:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 22 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.456396:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.456433:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 22 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.456449:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 22 pid: 8967 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.456477:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984826880:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789596871.456571:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596871.459589:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984826880:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596871.459625:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.462004:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.462823:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961710336 00000100:00100000:3.0:1789596871.462835:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961710336 00010000:00010000:3.0:1789596871.462881:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 23 pid: 8967 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.462928:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:3.0:1789596871.462938:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+23:2408:x1876527961710336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596871.462960:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596871.462968:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 23 pid: 8967 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.462982:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 23 pid: 8967 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.463005:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf90a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c47 expref: 23 pid: 8967 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.463022:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:3.0:1789596871.463029:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.463039:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.463080:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.463115:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596871.463176:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2408:x1876527961710336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 240us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.463194:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00010000:00010000:2.0:1789596871.463491:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463500:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463547:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463555:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463563:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463570:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ec2052e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.463575:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463583:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463593:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:2.0:1789596871.463603:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789596871.463608:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.463616:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052e00/0x7b5398e289bbf950 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.463730:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12463:x1876527961710208:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 7463us (7900us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789596871.463739:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:3.0:1789596871.468255:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.468338:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961710464 00000100:00100000:0.0:1789596871.468358:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961710464 00000100:00100000:0.0:1789596871.468432:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1789596871.468442:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2407:x1876527961710464:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789596871.468488:0:9893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.468511:0:9893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 8 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.468520:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596871.468524:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596871.468529:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.468566:0:9893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 8 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.468582:0:9893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 8 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.468598:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984827008:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596871.468717:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596871.474899:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.474983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961710592 00000100:00100000:2.0:1789596871.474992:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961710592 00010000:00010000:2.0:1789596871.475032:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 9 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.475085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789596871.475095:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961710592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596871.475113:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596871.475139:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 9 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.475153:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 9 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.475179:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596871.475197:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596871.475204:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.475233:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.475256:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596871.475312:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+9:2409:x1876527961710592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 217us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.475319:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00010000:00010000:0.0:1789596871.476305:0:9893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb49b774/0x7b5398e289bbf934 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c63 expref: 8 pid: 9893 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.476326:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9893:1876527984827008:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789596871.476360:0:9893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476371:0:9893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476550:0:9893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476579:0:9893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476588:0:9893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476597:0:9893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476604:0:9893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789596871.476609:0:9893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476635:0:9893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476651:0:9893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.476660:0:9893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bbf957 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.476923:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2407:x1876527961710464:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 8481us (8677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596871.476934:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:1.0:1789596871.483320:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.483635:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961710848 00000100:00100000:2.0:1789596871.483649:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961710848 00000100:00100000:2.0:1789596871.483988:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:2.0:1789596871.484002:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+21:12463:x1876527961710848:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789596871.484122:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.484144:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 21 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.484157:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.484213:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 21 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.484227:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 21 pid: 11184 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.484265:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984827136:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596871.484621:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596871.489791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.489865:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961710976 00000100:00100000:3.0:1789596871.489879:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961710976 00010000:00010000:3.0:1789596871.489928:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 22 pid: 11184 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596871.489980:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:3.0:1789596871.489992:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2408:x1876527961710976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596871.490009:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596871.490016:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 22 pid: 11184 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.490030:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 22 pid: 11184 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.490053:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:3.0:1789596871.490059:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.490102:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.490112:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.490120:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596871.490144:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596871.490216:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2408:x1876527961710976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 225us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.490223:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00010000:00010000:2.0:1789596871.493338:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bbf84d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c0f expref: 21 pid: 11184 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.493546:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984827136:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596871.493574:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.493587:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.493595:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.494166:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.494533:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.494545:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.494585:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.494601:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 21 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.494645:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984827264:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789596871.494771:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596871.501769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596871.501939:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961711104 00000100:00100000:1.0:1789596871.501971:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961711104 00010000:00010000:1.0:1789596871.502010:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 22 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596871.502052:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:1.0:1789596871.502063:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2408:x1876527961711104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596871.502087:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596871.502095:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 22 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.502108:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 22 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.502131:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:1.0:1789596871.502136:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.502145:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.502153:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.502171:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596871.502238:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2408:x1876527961711104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 177us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.502247:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00010000:00010000:2.0:1789596871.502436:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81670e00/0x7b5398e289bbf918 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c4e expref: 21 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.502455:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984827264:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596871.502476:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.502485:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.502490:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596871.502600:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789596871.502757:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789596871.502793:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789596871.502862:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876527984827392:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789596871.502909:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596871.502942:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984827392 00000100:00100000:2.0:1789596871.502946:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984827392 00000100:00100000:2.0:1789596871.502976:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789596871.502982:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876527984827392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789596871.503051:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876527984827392:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.503080:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789596871.503100:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb03999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596871.503113:0:6520:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789596871.503118:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1789596871.503131:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d83ded180, transno 4294967322 00000100:00100000:2.0:1789596871.503143:0:6520:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c7d83ded880 x1876527984826496/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789596887 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596871.503153:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876527984827392:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789596871.503272:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789596871.503307:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876527984827520:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789596871.503332:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596871.503350:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984827520 00000100:00100000:2.0:1789596871.503354:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984827520 00000100:00100000:2.0:1789596871.503369:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789596871.503375:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876527984827520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789596871.503452:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1876527984827520:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (119us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789596871.503459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789596871.503474:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596871.503489:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876527984827520:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789596871.503513:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503522:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503529:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503542:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.503547:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503556:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503569:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:2.0:1789596871.503572:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596871.503576:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503583:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf965 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503604:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503610:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503616:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503621:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.503623:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503629:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503646:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596871.503648:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596871.503654:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503663:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503672:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.503726:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.503737:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984827648:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789596871.503783:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596871.509420:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876527984827648:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789596871.509459:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509472:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671c00/0x7b5398e289bbf8a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509515:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509532:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509564:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509576:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509583:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509590:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509595:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.509599:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509608:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509634:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596871.509638:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596871.509642:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509649:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc000/0x7b5398e289bbf96c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509660:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509666:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509700:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509706:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789596871.509718:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509725:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509734:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596871.509738:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596871.509741:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.509747:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bbf95e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596871.510087:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596871.510093:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596871.510599:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789596871.510611:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596871.512305:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:12463:x1876527961710848:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 28291us (28984us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789596871.512326:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 246 00000020:00080000:2.0:1789596871.512339:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789596871.512809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.516004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961711232 00000100:00100000:2.0:1789596871.516020:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961711232 00000100:00100000:2.0:1789596871.516285:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789596871.516297:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:12462:x1876527961711232:12345-192.168.202.16@tcp:49:lfs.0 00000100:00100000:2.0:1789596871.516603:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:12462:x1876527961711232:12345-192.168.202.16@tcp:49:lfs.0 Request processed in 308us (3795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.516811:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789596871.521591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.521742:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.521996:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961711744 00000100:00100000:0.0:1789596871.522007:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961711744 00000100:00100000:0.0:1789596871.522085:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:0.0:1789596871.522095:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+24:12462:x1876527961711744:12345-192.168.202.16@tcp:58:lfs.0 00000040:00080000:0.0:1789596871.522278:0:8967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789596871.522595:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+24:12462:x1876527961711744:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 500us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596871.522603:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:3.0:1789596871.527857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961711488 00000100:00100000:3.0:1789596871.527878:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961711488 00000100:00100000:2.0:1789596871.528615:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:2.0:1789596871.528644:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+24:12463:x1876527961711488:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789596871.529152:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789596871.529196:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789596871.529234:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.529254:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.529267:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.529278:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.529285:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.529292:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.529306:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789596871.529842:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596871.529851:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.529874:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789596871.529879:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.529887:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.529902:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:1.0:1789596871.529906:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789596871.529910:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.529915:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc400/0x7b5398e289bbf973 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.529929:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596871.529930:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596871.529932:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596871.530943:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+26:12463:x1876527961711488:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 2292us (9350us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789596871.531144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000020:00080000:2.0:1789596871.531166:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789596871.576308:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596871.576538:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961711872 00000100:00100000:0.0:1789596871.576553:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961711872 00000100:00100000:0.0:1789596871.576657:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:0.0:1789596871.576668:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+26:12465:x1876527961711872:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596871.577060:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596871.577098:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf97a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c6a expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577176:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577204:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577218:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577234:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577241:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577248:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577342:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577355:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577364:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577602:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596871.577822:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 27 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596871.577844:0:11184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984827776:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789596871.577969:0:11184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596871.587217:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.587422:0:11184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11184:1876527984827776:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789596871.587451:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596871.587652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712128 00000100:00100000:1.0:1789596871.587663:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712128 00000100:00100000:1.0:1789596871.587764:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1789596871.587783:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+28:6178:x1876527961712128:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789596871.588098:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:6178:x1876527961712128:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 324us (890us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789596871.588107:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1789596871.595936:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.596212:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712256 00000100:00100000:2.0:1789596871.596226:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712256 00010000:00010000:2.0:1789596871.596274:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 29 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596871.596328:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:2.0:1789596871.596340:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:2407:x1876527961712256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596871.596367:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596871.596375:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 29 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.596401:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 29 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.596426:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bbf89a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c2b expref: 29 pid: 6519 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.596444:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596871.596449:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.596459:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.596483:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596871.596527:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596871.596618:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+28:2407:x1876527961712256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 279us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.596626:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00010000:00010000:1.0:1789596871.597056:0:11184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597090:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596871.597159:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789596871.597165:0:11184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789596871.597196:0:11184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597214:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597225:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597233:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597241:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597248:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.597253:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597262:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597273:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:1.0:1789596871.597276:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.597281:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597297:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bbf981 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597314:0:11184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597320:0:11184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597326:0:11184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597332:0:11184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596871.597334:0:11184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597339:0:11184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597347:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c7d8259c600) 00010000:00010000:1.0:1789596871.597349:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596871.597352:0:11184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597358:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742800/0x7b5398e289bbf988 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597589:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bbf97a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c6a expref: 28 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597620:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c6a expref: 27 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596871.597628:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:1.0:1789596871.597631:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596871.597633:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743200, rc 0) 00000100:00100000:1.0:1789596871.597745:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12465:x1876527961711872:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 21078us (21446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.597754:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:1.0:1789596871.616144:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596871.616179:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984827904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596871.616277:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596871.618044:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984827904 00000100:00100000:2.0:1789596871.618061:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984827904 00000100:00100000:2.0:1789596871.618140:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789596871.618151:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984827904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596871.618208:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596871.618308:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984827904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.618315:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789596871.620039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984827904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596871.675347:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.675451:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.675483:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.675528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712384 00000100:00100000:3.0:1789596871.675538:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712384 00000100:00100000:3.0:1789596871.675587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 397 00000100:00100000:3.0:1789596871.675597:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961712384:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596871.675662:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2407:x1876527961712384:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.675669:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 397 00000100:00100000:2.0:1789596871.685818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.685863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596871.685950:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712896 00000100:00100000:3.0:1789596871.685984:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712896 00000100:00100000:3.0:1789596871.686080:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:3.0:1789596871.686094:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961712896:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596871.686222:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961712896:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.686231:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00080000:3.0:1789596871.686260:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596871.693798:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712512 00000100:00100000:0.0:1789596871.693817:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712512 00000100:00100000:2.0:1789596871.694078:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.694144:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596871.694589:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712768 00000100:00100000:2.0:1789596871.694594:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712768 00000100:00100000:2.0:1789596871.694630:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1789596871.694639:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2406:x1876527961712768:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596871.694767:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2406:x1876527961712768:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 128us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596871.694775:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:1.0:1789596871.696980:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961712640 00000100:00100000:1.0:1789596871.696998:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961712640 00000100:00080000:1.0:1789596871.697062:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596871.697644:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961713152 00000100:00100000:1.0:1789596871.697650:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961713152 00000100:00080000:1.0:1789596871.697668:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596871.697702:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961713024 00000100:00100000:1.0:1789596871.697767:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961713024 00000100:00080000:1.0:1789596871.697785:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596871.697814:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 356 00000100:00100000:1.0:1789596871.697826:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+27:2406:x1876527961712512:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596871.698040:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+27:2406:x1876527961712512:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 215us (22702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.698102:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 356 00000100:00100000:3.0:1789596871.698225:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 357 00000100:00100000:3.0:1789596871.698236:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961712640:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596871.698346:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 358 00000100:00100000:1.0:1789596871.698354:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961713152:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596871.698556:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2407:x1876527961713152:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (12520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.698563:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 358 00000100:00100000:1.0:1789596871.698580:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 359 00000100:00100000:1.0:1789596871.698587:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961713024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789596871.698615:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961713024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (4473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596871.698620:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 359 00000100:00100000:3.0:1789596871.698877:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2407:x1876527961712640:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 642us (23391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596871.698884:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 357 00010000:00010000:0.0:1789596872.143550:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596872.573864:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596872.573875:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596872.573917:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789596872.573925:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789596872.574096:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984828032:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596872.574218:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596872.582938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596872.583026:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961713280 00000100:00100000:2.0:1789596872.583039:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961713280 00000100:00100000:2.0:1789596872.583110:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:2.0:1789596872.583123:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+28:12477:x1876527961713280:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789596872.583171:0:8967:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789596872.583344:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+28:12477:x1876527961713280:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 223us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596872.583351:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:3.0:1789596872.583725:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1876527984828032:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596872.600327:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596872.600755:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961713536 00000100:00100000:3.0:1789596872.600769:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961713536 00000100:00100000:3.0:1789596872.600834:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:3.0:1789596872.600845:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+27:12477:x1876527961713536:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596872.600866:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596872.600888:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052600/0x7b5398e289bbf996 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c71 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596872.601238:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052200/0x7b5398e289bbf99d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596872.601259:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052200/0x7b5398e289bbf99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596872.601276:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052200/0x7b5398e289bbf99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596872.601290:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789596872.602826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052600/0x7b5398e289bbf996 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c71 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596872.602860:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052200/0x7b5398e289bbf99d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c71 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596872.602871:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:3.0:1789596872.602875:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596872.602879:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ec2052200, rc 0) 00000100:00100000:3.0:1789596872.603279:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:12477:x1876527961713536:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2431us (2962us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789596872.603290:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:1.0:1789596872.611668:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596872.611803:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961713664 00000100:00100000:2.0:1789596872.611816:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961713664 00000100:00100000:2.0:1789596872.611898:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789596872.611911:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+29:2406:x1876527961713664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596872.611930:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596872.611959:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ec2052200/0x7b5398e289bbf99d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c71 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596872.611984:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:2.0:1789596872.611992:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596872.612071:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+28:2406:x1876527961713664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 162us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596872.612078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789596872.628219:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596872.635057:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961713920 00000100:00100000:0.0:1789596872.635077:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961713920 00000100:00100000:1.0:1789596872.638917:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:1.0:1789596872.638931:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+28:12477:x1876527961713920:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789596872.639033:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639052:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639068:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639252:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639260:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639268:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639275:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596872.639278:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639286:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639299:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:1.0:1789596872.639302:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596872.639307:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.639313:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bbf9ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596872.639850:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+29:12477:x1876527961713920:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 917us (11636us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789596872.639861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 251 00000040:00080000:3.0:1789596872.640189:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596872.640194:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596872.640737:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789596872.640752:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789596872.643930:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596872.644024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961714176 00000100:00100000:0.0:1789596872.644038:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961714176 00000100:00100000:0.0:1789596872.644112:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789596872.644124:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+29:12477:x1876527961714176:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789596872.644431:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+30:12477:x1876527961714176:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 308us (513us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789596872.644438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000040:00080000:3.0:1789596872.736714:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596872.736725:0:14661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596872.736847:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789596872.736856:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596872.975350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596872.975665:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961714432 00000100:00100000:0.0:1789596872.975700:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961714432 00000100:00100000:0.0:1789596872.975773:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:0.0:1789596872.975785:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+30:12490:x1876527961714432:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789596872.975821:0:11184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596872.975845:0:11184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf9b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c78 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596872.975970:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf9b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596872.975985:0:11184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596872.975998:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596872.976012:0:11184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789596872.976155:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bbf9b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c78 expref: 33 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596872.976187:0:11184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c78 expref: 32 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596872.976197:0:11184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:0.0:1789596872.976200:0:11184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789596872.976204:0:11184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596872.976287:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+32:12490:x1876527961714432:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 504us (946us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789596872.976294:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:3.0:1789596872.985102:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596872.985304:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961714560 00000100:00100000:1.0:1789596872.985313:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961714560 00000100:00100000:1.0:1789596872.985387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:1.0:1789596872.985396:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+32:12490:x1876527961714560:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1789596872.985484:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985508:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985524:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985577:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985584:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985591:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985596:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596872.985602:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985609:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985624:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:1.0:1789596872.985627:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596872.985632:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596872.985648:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bbf9c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596872.985754:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+32:12490:x1876527961714560:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 358us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596872.985762:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:0.0:1789596873.067362:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596873.067481:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961714688 00000100:00100000:2.0:1789596873.067495:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961714688 00000100:00100000:2.0:1789596873.067562:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:2.0:1789596873.067571:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2409:x1876527961714688:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789596873.067586:0:9893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596873.067604:0:9893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bbf9ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c7f expref: -99 pid: 9893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596873.067628:0:9893:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aab14c7, atime: 0x6aab14c6, ctime: 0x6aab14c7, blocks: 0x8 00010000:00010000:2.0:1789596873.067650:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1789596873.067655:0:9893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596873.067664:0:9893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bbf9ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c7f expref: 8 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.067737:0:9893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bbf9ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c7f expref: 8 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.067752:0:9893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dce00, rc 0) 00000100:00100000:2.0:1789596873.067810:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2409:x1876527961714688:12345-192.168.202.16@tcp:101:cat.0 Request processed in 241us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596873.067817:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00080000:1.0:1789596873.068526:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596873.071841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596873.071904:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961714816 00000100:00100000:0.0:1789596873.071915:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961714816 00002000:00100000:0.0:1789596873.071991:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9c7d83efad80 x1876527961714816/t0(0) o3->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:754/0 lens 488/0 e 0 to 0 dl 1789596884 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596873.072003:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d83efad80 with x1876527961714816 ext(0->4095) 00002000:00010000:0.0:1789596873.072009:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d83efad80 00000100:00100000:0.0:1789596873.072043:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789596873.072054:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2407:x1876527961714816:12345-192.168.202.16@tcp:3:cat.0 00000100:00100000:0.0:1789596873.072236:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2407:x1876527961714816:12345-192.168.202.16@tcp:3:cat.0 Request processed in 183us (403us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789596873.072243:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00002000:00100000:0.0:1789596873.072251:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9c7d83efad80 x1876527961714816/t0(0) o3->2396ff16-3863-41e8-8748-2ac67b0298b6@192.168.202.16@tcp:754/0 lens 488/4536 e 0 to 0 dl 1789596884 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596873.072259:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7d83efad80 with x1876527961714816 ext(0->4095) 00002000:00010000:0.0:1789596873.072262:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7d83efad80 00010000:00010000:1.0:1789596873.149157:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596873.661055:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984828160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596873.661137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596873.661389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828160 00000100:00100000:3.0:1789596873.661409:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828160 00000100:00100000:3.0:1789596873.661477:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789596873.661488:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984828160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596873.661529:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789596873.668083:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984828160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6585us (6933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596873.668099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789596873.668475:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984828160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789596874.174232:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596874.686226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984828288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596874.686351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596874.688414:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828288 00000100:00100000:0.0:1789596874.688429:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828288 00000100:00100000:0.0:1789596874.688516:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789596874.688530:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984828288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596874.688572:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789596874.688649:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984828288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596874.688656:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1789596874.688702:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596874.688749:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984828288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789596874.690317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984828416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596874.690390:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596874.690462:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828416 00000100:00100000:2.0:1789596874.690479:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828416 00000100:00100000:2.0:1789596874.690546:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789596874.690556:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876527984828416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596874.690579:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789596874.690621:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876527984828416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596874.690628:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789596874.690666:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984828416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596874.692793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596875.198474:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596875.198497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984828544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596875.198572:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.198639:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828544 00000100:00100000:3.0:1789596875.198647:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828544 00010000:00010000:0.0:1789596875.198721:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596875.198740:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789596875.198740:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596875.198749:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984828672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596875.198754:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984828544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596875.198779:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789596875.198782:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596875.198807:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828672 00000100:00100000:0.0:1789596875.198811:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828672 00000100:00100000:3.0:1789596875.198820:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984828544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596875.198827:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789596875.198861:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596875.200719:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984828800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.200799:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.201534:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984828544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596875.201590:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984828928:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.202456:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596875.203142:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789596875.203172:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984828672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596875.203199:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596875.203264:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984828672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596875.203272:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789596875.203423:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984828672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596875.209589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828800 00000100:00100000:1.0:1789596875.209609:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828800 00000100:00100000:1.0:1789596875.209704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789596875.209715:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984828800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.209815:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984828800:12345-0@lo:400:kworker.0 Request processed in 102us (9015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.209823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789596875.209875:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984828928 00000100:00100000:1.0:1789596875.209878:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984828928 00000100:00100000:1.0:1789596875.209916:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789596875.209923:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984828928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.209987:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984828928:12345-0@lo:400:kworker.0 Request processed in 64us (7534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.210001:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789596875.210028:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984828928:0@lo:400:kworker.0 00000100:00100000:0.0:1789596875.210172:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984828800:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210302:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984829056:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210355:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.210384:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984829568:0@lo:400:kworker.0 00000100:00100000:0.0:1789596875.210392:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984829312:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210407:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596875.210418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.210424:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789596875.210429:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984829184:0@lo:400:kworker.0 00000100:00100000:0.0:1789596875.210434:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596875.210438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984829440:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210450:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.210472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984829696:0@lo:400:kworker.0 00000100:00100000:0.0:1789596875.210472:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.210493:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.210576:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829056 00000100:00100000:3.0:1789596875.210580:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829056 00000100:00100000:2.0:1789596875.210589:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984829824:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210601:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829312 00000100:00100000:3.0:1789596875.210613:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829312 00000100:00100000:2.0:1789596875.210616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596875.210632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829568 00000100:00100000:3.0:1789596875.210636:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789596875.210636:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829568 00000100:00100000:3.0:1789596875.210641:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984829056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829184 00000100:00100000:1.0:1789596875.210669:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829184 00000100:00100000:3.0:1789596875.210697:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984829056:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596875.210704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789596875.210706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829440 00000100:00100000:1.0:1789596875.210709:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829440 00000100:00100000:3.0:1789596875.210717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789596875.210722:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984829312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789596875.210727:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984829568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210750:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984829312:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.210751:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984829568:12345-0@lo:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596875.210756:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789596875.210756:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789596875.210765:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789596875.210771:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984829184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210772:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789596875.210778:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984829440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210795:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984829184:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596875.210797:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984829440:12345-0@lo:400:kworker.0 Request processed in 20us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.210801:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789596875.210811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:1.0:1789596875.210817:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596875.210821:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596875.210826:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596875.210834:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984829952:0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210834:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984830080:0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210856:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596875.210866:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984829184:0@lo:400:kworker.0 00010000:00080000:3.0:1789596875.210878:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e7b480 x1876527984829568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596875.210886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830080 00000100:00100000:1.0:1789596875.210889:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830080 00000100:00100000:3.0:1789596875.210901:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984829568:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.210912:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984829056:0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210913:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789596875.210918:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984830080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.210949:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984830080:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.210954:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:1.0:1789596875.210969:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789596875.210983:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e79f80 x1876527984830080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596875.210992:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984830080:0@lo:400:kworker.0 00000100:00100000:3.0:1789596875.211125:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596875.211535:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829952 00000100:00100000:1.0:1789596875.211541:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829952 00000100:00100000:1.0:1789596875.211575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789596875.211582:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.211616:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984829952:12345-0@lo:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.211623:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:3.0:1789596875.211774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596875.211794:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984829952:0@lo:400:kworker.0 00000100:00100000:0.0:1789596875.223024:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829696 00000100:00100000:0.0:1789596875.223044:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829696 00000100:00100000:0.0:1789596875.225537:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984829824 00000100:00100000:0.0:1789596875.225556:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984829824 00000100:00100000:2.0:1789596875.225665:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984829440:0@lo:400:kworker.0 00000100:00100000:2.0:1789596875.225702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984829312:0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.225917:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789596875.225940:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984829696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.226039:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984829696:12345-0@lo:400:kworker.0 Request processed in 102us (15543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.226046:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789596875.226066:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789596875.226073:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876527984829824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596875.226108:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876527984829824:12345-0@lo:400:kworker.0 Request processed in 35us (15491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.226142:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789596875.226353:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984829696:0@lo:400:kworker.0 00000100:00100000:2.0:1789596875.226379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984829824:0@lo:400:kworker.0 00000040:00080000:1.0:1789596875.261371:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789596875.708833:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596875.708844:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596875.708864:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789596875.708871:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789596876.229350:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596876.735113:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596876.735157:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984830208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596876.735255:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596876.735479:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830208 00000100:00100000:2.0:1789596876.735491:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830208 00000100:00100000:2.0:1789596876.735548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789596876.735558:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984830208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596876.735603:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596876.735667:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984830208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596876.735675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789596876.735742:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984830208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789596876.802347:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802444:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802471:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802516:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802561:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596876.802595:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715456 00000100:00100000:0.0:1789596876.802605:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715456 00000100:00100000:0.0:1789596876.802713:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715328 00000100:00100000:0.0:1789596876.802716:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715328 00000100:00100000:0.0:1789596876.802750:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:0.0:1789596876.802763:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961715456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596876.802856:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961715456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 96us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596876.802864:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:0.0:1789596876.802888:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:0.0:1789596876.802896:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2406:x1876527961715328:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596876.802908:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961714944 00000100:00100000:3.0:1789596876.802916:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961714944 00000100:00100000:0.0:1789596876.802926:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+8:2406:x1876527961715328:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596876.802933:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:0.0:1789596876.802963:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715200 00000100:00100000:0.0:1789596876.802967:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715200 00000100:00100000:3.0:1789596876.802971:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 399 00000100:00100000:3.0:1789596876.802982:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961714944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596876.803005:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715712 00000100:00100000:0.0:1789596876.803009:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715712 00000100:00100000:3.0:1789596876.803019:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:454a6744-d65e-403d-97e2-e8496b673d4c+13:2406:x1876527961714944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596876.803025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715072 00000100:00100000:3.0:1789596876.803028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 399 00000100:00100000:0.0:1789596876.803030:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715072 00000100:00100000:0.0:1789596876.803049:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715584 00000100:00100000:0.0:1789596876.803053:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715584 00000100:00100000:0.0:1789596876.803075:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 366 00000100:00100000:0.0:1789596876.803084:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961715200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596876.803092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 367 00000100:00100000:3.0:1789596876.803103:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961715712:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596876.803121:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2406:x1876527961715200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596876.803146:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961715712:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596876.803159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 366 00000100:00100000:3.0:1789596876.809096:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 367 00000100:00100000:3.0:1789596876.809163:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 368 00000100:00100000:3.0:1789596876.809182:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+32:2406:x1876527961715072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596876.809264:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+32:2406:x1876527961715072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 91us (6768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596876.809271:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 368 00000100:00100000:3.0:1789596876.809285:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 369 00000100:00100000:3.0:1789596876.809293:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961715584:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596876.809320:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2406:x1876527961715584:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (6760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596876.809326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 369 00000100:00080000:0.0:1789596876.813554:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596876.813569:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789596876.813573:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596876.813577:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789596877.246004:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789596877.249639:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1789596877.249711:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1789596877.250351:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789596877.250379:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7eb03999c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789596877.250385:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7e92afdc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7eb0399900 00000020:00080000:0.0:1789596877.250389:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7e92afd200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7ebfac6000 00000020:00080000:0.0:1789596877.250416:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1789596877.250512:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596877.250526:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596877.250534:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596877.250541:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789596877.250546:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596877.250554:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596877.250573:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c7d825db200) 00010000:00010000:1.0:1789596877.250576:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596877.250581:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596877.250588:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bbf949 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8967 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789596877.250910:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789596877.251010:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789596877.251671:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1789596878.272643:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596878.788850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984830336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596878.788925:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596878.789059:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830336 00000100:00100000:2.0:1789596878.789067:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830336 00000100:00100000:2.0:1789596878.789255:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789596878.789265:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984830336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789596878.789300:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789596878.789360:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984830336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596878.789367:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789596878.789957:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984830336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596879.098004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596879.098111:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715840 00000100:00100000:3.0:1789596879.098140:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715840 00000100:00100000:3.0:1789596879.098293:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:3.0:1789596879.098305:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:12151:x1876527961715840:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1789596879.098585:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596879.103228:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:12151:x1876527961715840:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 549us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596879.103246:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:1.0:1789596879.105199:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596879.105313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961715968 00000100:00100000:3.0:1789596879.105324:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961715968 00000100:00100000:3.0:1789596879.105424:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:3.0:1789596879.105435:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:12151:x1876527961715968:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789596879.105558:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:12151:x1876527961715968:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 125us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596879.105565:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00080000:1.0:1789596879.105728:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596879.112555:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596879.112728:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716224 00000100:00100000:1.0:1789596879.112740:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716224 00000100:00100000:1.0:1789596879.112833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789596879.112845:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+18:12151:x1876527961716224:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789596879.113126:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+19:12151:x1876527961716224:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 282us (581us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789596879.113135:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00010000:00010000:1.0:1789596879.293412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596879.806643:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984830464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596879.806746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596879.806874:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830464 00000100:00100000:2.0:1789596879.806886:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830464 00000100:00100000:2.0:1789596879.806954:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789596879.806963:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984830464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596879.806991:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789596879.807032:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984830464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596879.807038:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789596879.807500:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596879.807538:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789596879.807550:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d83ded880, transno 4294967323 00000004:00080000:3.0:1789596879.807564:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789596879.807594:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984830464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596879.808794:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984830592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596879.808869:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596879.808971:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830592 00000100:00100000:0.0:1789596879.808978:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830592 00000100:00100000:0.0:1789596879.809031:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789596879.809039:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984830592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596879.809057:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789596879.809098:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984830592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596879.809105:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789596879.809176:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984830592:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789596879.809349:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596880.318852:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984830848:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.318949:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.319022:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984831360:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.319046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.319065:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984831872:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.319088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.319367:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984831104:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.319402:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.319426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984831616:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.319456:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.319477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984832128:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.319499:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.320154:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789596880.320312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830848 00000100:00100000:2.0:1789596880.320323:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830848 00000100:00100000:2.0:1789596880.320372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831360 00000100:00100000:2.0:1789596880.320375:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831360 00000100:00100000:2.0:1789596880.320398:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831872 00000100:00100000:2.0:1789596880.320402:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831872 00000100:00100000:2.0:1789596880.320416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831104 00000100:00100000:2.0:1789596880.320418:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831104 00000100:00100000:2.0:1789596880.320433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789596880.320444:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984830848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.320600:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984830720:0@lo:400:kworker.0 00000100:00100000:2.0:1789596880.320766:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984830848:12345-0@lo:400:kworker.0 Request processed in 324us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.320775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789596880.320798:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789596880.320805:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984831360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596880.320837:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984831360:12345-0@lo:400:kworker.0 Request processed in 33us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.320843:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789596880.320855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789596880.320860:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984831872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596880.320896:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984831872:12345-0@lo:400:kworker.0 Request processed in 35us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.320901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789596880.320912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789596880.320918:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984831104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596880.320945:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984831104:12345-0@lo:400:kworker.0 Request processed in 28us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.320950:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789596880.321032:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984832512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596880.321066:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.321101:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596880.321116:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596880.321139:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.321334:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.321364:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984831232:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.321392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.321414:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984831744:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.321437:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.321456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984832256:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.321475:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.321526:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984831104:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322277:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789596880.322299:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984830976:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322343:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.322369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984831488:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322394:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.322412:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984832000:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322433:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.322457:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984830848:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322469:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984831360:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984831872:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322533:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831488 00000100:00100000:1.0:1789596880.322540:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831488 00000100:00100000:1.0:1789596880.322582:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832000 00000100:00100000:1.0:1789596880.322586:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832000 00000100:00100000:1.0:1789596880.322603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789596880.322611:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984831488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322697:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984831488:12345-0@lo:400:kworker.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.322703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789596880.322717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789596880.322723:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984832000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322749:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984832000:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.322755:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789596880.322783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830720 00000100:00100000:1.0:1789596880.322787:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830720 00000100:00100000:1.0:1789596880.322820:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789596880.322826:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.322868:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d576172c-8178-43f9-add9-c496dd76058d+24:3646:x1876527984830720:12345-0@lo:400:kworker.0 Request processed in 41us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.322875:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789596880.322934:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984830720:0@lo:400:kworker.0 00010000:00080000:1.0:1789596880.322962:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb026a00 x1876527984831488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596880.322990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984831488:0@lo:400:kworker.0 00010000:00080000:1.0:1789596880.323003:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb024e00 x1876527984832000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596880.323010:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984832000:0@lo:400:kworker.0 00000100:00100000:1.0:1789596880.323073:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831616 00000100:00100000:1.0:1789596880.323078:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831616 00000100:00100000:1.0:1789596880.323117:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832128 00000100:00100000:1.0:1789596880.323120:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832128 00000100:00100000:1.0:1789596880.323137:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831744 00000100:00100000:1.0:1789596880.323139:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831744 00000100:00100000:1.0:1789596880.323148:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832256 00000100:00100000:1.0:1789596880.323150:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832256 00010000:00010000:3.0:1789596880.323855:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596880.323896:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832512 00000100:00100000:3.0:1789596880.323902:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832512 00000100:00100000:3.0:1789596880.323936:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832384 00000100:00100000:3.0:1789596880.323941:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832384 00000100:00100000:3.0:1789596880.323958:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789596880.323966:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984832512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789596880.323996:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596880.324047:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984832512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324055:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789596880.324070:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789596880.324077:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984832384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596880.324086:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596880.324123:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984832384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324129:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789596880.324389:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789596880.324397:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7d84451500, transno 4294967311 00000100:00100000:3.0:1789596880.324401:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984831232 00000100:00100000:3.0:1789596880.324409:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984831232 00000100:00100000:3.0:1789596880.324433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984830976 00000100:00100000:3.0:1789596880.324436:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984830976 00000100:00100000:3.0:1789596880.324449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789596880.324454:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984831232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.324501:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984831232:12345-0@lo:400:kworker.0 Request processed in 46us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789596880.324518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789596880.324524:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984830976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.324555:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984830976:12345-0@lo:400:kworker.0 Request processed in 32us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324560:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789596880.324590:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984831232:0@lo:400:kworker.0 00000100:00100000:2.0:1789596880.324742:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596880.324772:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984832512:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789596880.324789:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596880.324796:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789596880.324798:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596880.324819:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789596880.324830:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984831616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.324871:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984831616:12345-0@lo:400:kworker.0 Request processed in 44us (5414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324877:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789596880.324892:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789596880.324898:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984832128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.324927:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984832128:12345-0@lo:400:kworker.0 Request processed in 29us (5427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324940:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789596880.324953:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789596880.324960:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984831744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.324991:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984831744:12345-0@lo:400:kworker.0 Request processed in 32us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.324995:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789596880.325005:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789596880.325011:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984832256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.325036:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984832256:12345-0@lo:400:kworker.0 Request processed in 25us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.325041:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789596880.325069:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984831744:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.325082:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984832256:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.325096:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984831616:0@lo:400:kworker.0 00000100:00100000:2.0:1789596880.325179:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984832128:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.326263:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984830976:0@lo:400:kworker.0 00000001:02000400:2.0:1789596881.066129:0:14858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:14:40 (1789596880) 00010000:00010000:0.0:1789596881.341713:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596881.853005:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984832640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596881.853138:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596881.853253:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832640 00000100:00100000:2.0:1789596881.853263:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832640 00000100:00100000:2.0:1789596881.853326:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789596881.853337:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984832640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596881.853387:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789596881.853450:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984832640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596881.853458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789596881.853525:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984832640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596881.913901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596881.913956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596881.913993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596881.914108:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596881.914136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596881.914155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596881.914216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716352 00000100:00100000:3.0:1789596881.914232:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716352 00000100:00100000:3.0:1789596881.914316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 401 00000100:00100000:3.0:1789596881.914330:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961716352:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596881.914435:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2408:x1876527961716352:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 107us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596881.914443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 401 00000100:00100000:0.0:1789596881.914591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716608 00000100:00100000:0.0:1789596881.914620:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716608 00000100:00080000:3.0:1789596881.914655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789596881.914716:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961717120 00000100:00100000:0.0:1789596881.914720:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961717120 00000100:00100000:3.0:1789596881.914796:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716480 00000100:00100000:3.0:1789596881.914801:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716480 00000100:00100000:0.0:1789596881.915566:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 376 00000100:00100000:0.0:1789596881.915578:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961716608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596881.915666:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961716608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 88us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596881.915675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 376 00000100:00100000:0.0:1789596881.915728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:0.0:1789596881.915736:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2408:x1876527961717120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789596881.915764:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d191948b-51c9-4843-830f-05feb1db7f03+5:2408:x1876527961717120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596881.915770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:3.0:1789596881.916352:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 378 00000100:00100000:3.0:1789596881.916362:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+19:2408:x1876527961716480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789596881.916408:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+19:2408:x1876527961716480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 49us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596881.916416:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 378 00000100:00100000:2.0:1789596881.916805:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716864 00000100:00100000:2.0:1789596881.916818:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716864 00000100:00100000:2.0:1789596881.916883:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716736 00000100:00100000:2.0:1789596881.916888:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716736 00000100:00100000:2.0:1789596881.916919:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:2.0:1789596881.916929:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961716864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596881.916973:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2408:x1876527961716864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (2979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596881.916980:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:2.0:1789596881.917335:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789596881.917348:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961716736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789596881.917389:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2408:x1876527961716736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (3233us total) trans 0 rc 0/0 00000100:00080000:3.0:1789596881.917576:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789596881.917582:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596881.917585:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596881.917588:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596881.917883:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:1.0:1789596881.919210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596881.919724:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961716992 00000100:00100000:0.0:1789596881.919739:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961716992 00000100:00100000:0.0:1789596881.919833:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:0.0:1789596881.919846:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2408:x1876527961716992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00080000:3.0:1789596881.919936:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596881.919953:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2408:x1876527961716992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 109us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596881.919961:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 379 00010000:00010000:0.0:1789596882.374187:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596883.393534:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789596883.396617:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1789596883.396642:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789596883.396704:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789596883.396720:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1789596883.479974:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596883.480049:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961717248 00000100:00100000:2.0:1789596883.480064:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961717248 00000100:00100000:2.0:1789596883.480206:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:2.0:1789596883.480221:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:13162:x1876527961717248:12345-192.168.202.16@tcp:101:lsof.0 00010000:00010000:2.0:1789596883.480250:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596883.480279:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf9d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596883.480369:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf9dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596883.480386:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596883.480402:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596883.480466:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789596883.480470:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789596883.480522:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596883.480553:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bbf9d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c86 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596883.480596:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf9dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c86 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596883.480620:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:2.0:1789596883.480624:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596883.480628:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dda00, rc 0) 00000100:00100000:2.0:1789596883.480744:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:13162:x1876527961717248:12345-192.168.202.16@tcp:101:lsof.0 Request processed in 525us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596883.480753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00080000:3.0:1789596883.480822:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596883.901190:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984832768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596883.901302:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596883.901585:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832768 00000100:00100000:2.0:1789596883.901599:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832768 00000100:00100000:2.0:1789596883.901668:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789596883.901707:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984832768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789596883.901755:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789596883.901926:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984832768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 247us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596883.901934:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789596883.904087:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984832768:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596884.413974:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596884.925966:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984832896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596884.926092:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596884.926447:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984832896 00000100:00100000:2.0:1789596884.926461:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984832896 00000100:00100000:2.0:1789596884.926546:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789596884.926560:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984832896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596884.926616:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789596884.926702:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984832896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596884.926709:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789596884.926794:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984832896:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596884.926985:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596884.930382:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984833024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596884.930499:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596884.938469:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833024 00000100:00100000:0.0:1789596884.938547:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833024 00000100:00100000:0.0:1789596884.938852:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789596884.938869:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984833024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596884.938923:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789596884.939229:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984833024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 359us (8724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596884.939239:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789596884.939626:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984833024:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789596884.939722:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596885.428000:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596885.428193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961717504 00000100:00100000:0.0:1789596885.428208:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961717504 00000100:00080000:3.0:1789596885.435025:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596885.437774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984833152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789596885.437902:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.438022:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833152 00000100:00100000:2.0:1789596885.438034:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833152 00000100:00100000:2.0:1789596885.438118:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789596885.438131:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984833152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789596885.438174:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789596885.438230:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984833152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.438238:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1789596885.438265:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596885.438312:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984833152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789596885.438541:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789596885.438557:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+18:13163:x1876527961717504:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:0.0:1789596885.438874:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:13163:x1876527961717504:12345-192.168.202.16@tcp:35:umount.0 Request processed in 323us (11635us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789596885.438976:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596885.438984:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984833280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596885.439015:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596885.439319:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833280 00000100:00100000:3.0:1789596885.439324:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833280 00000100:00100000:3.0:1789596885.439367:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789596885.439373:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984833280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596885.439402:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596885.439427:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984833280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596885.439432:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789596885.439460:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984833280:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789596885.439480:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789596885.439493:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596885.442996:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789596885.446521:0:6523:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1789596885.446558:0:6523:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789596885.447405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789596885.447459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961717760 00000100:00100000:0.0:1789596885.447473:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961717760 00000100:00100000:0.0:1789596885.447523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789596885.447535:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+19:13163:x1876527961717760:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:0.0:1789596885.448004:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+20:13163:x1876527961717760:12345-192.168.202.16@tcp:35:umount.0 Request processed in 470us (5083us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789596885.448013:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789596885.452129:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984833408:0@lo:400:kworker.0 00000100:00100000:0.0:1789596885.452230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.452346:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596885.452361:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984833664:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.452397:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.452470:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833664 00000100:00100000:2.0:1789596885.452480:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833664 00000100:00100000:2.0:1789596885.452531:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789596885.452546:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.452602:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984833664:12345-0@lo:400:kworker.0 Request processed in 57us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.452610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789596885.452658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984833664:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.452716:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984833792:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.452758:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.452845:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596885.452851:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984834176:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.452876:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.452903:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833792 00000100:00100000:2.0:1789596885.452907:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833792 00000100:00100000:2.0:1789596885.452934:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834176 00000100:00100000:2.0:1789596885.452936:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834176 00000100:00100000:2.0:1789596885.452963:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789596885.452969:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984833792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.452999:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984833792:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.453006:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789596885.453016:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789596885.453021:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984834176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.453045:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984834176:12345-0@lo:400:kworker.0 Request processed in 24us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.453051:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00080000:2.0:1789596885.453089:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c14a80 x1876527984834176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596885.453101:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984834176:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.453112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984833792:0@lo:400:kworker.0 00000100:00080000:3.0:1789596885.453139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596885.453150:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984834304:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.453177:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.453295:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596885.453312:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984834688:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.453334:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.453355:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834688 00000100:00100000:2.0:1789596885.453358:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834688 00000100:00100000:2.0:1789596885.453383:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789596885.453389:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984834688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.453417:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984834688:12345-0@lo:400:kworker.0 Request processed in 28us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.453423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00080000:2.0:1789596885.453447:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c14e00 x1876527984834688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596885.453449:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596885.453461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984834688:0@lo:400:kworker.0 00000100:00100000:3.0:1789596885.453495:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961718016 00000100:00100000:3.0:1789596885.453501:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961718016 00000100:00080000:2.0:1789596885.453506:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789596885.453544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:3.0:1789596885.453554:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e87f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+20:13163:x1876527961718016:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:1.0:1789596885.453735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833408 00000100:00100000:1.0:1789596885.453741:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833408 00000100:00100000:1.0:1789596885.453782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789596885.453791:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984833408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.453883:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984833408:12345-0@lo:400:kworker.0 Request processed in 94us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596885.453890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789596885.453928:0:9893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834304 00000100:00100000:1.0:1789596885.453932:0:9893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834304 00000100:00100000:1.0:1789596885.454070:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596885.454079:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984834304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.454122:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984834304:12345-0@lo:400:kworker.0 Request processed in 46us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596885.454128:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596885.454151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984833536:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.454180:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.454300:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984833408:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454317:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984833920:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454340:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.454358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984834432:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596885.454398:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833920 00000100:00100000:2.0:1789596885.454401:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833920 00000100:00100000:2.0:1789596885.454424:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789596885.454430:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984833920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454460:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984833920:12345-0@lo:400:kworker.0 Request processed in 30us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.454466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789596885.454502:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984833920:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454519:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984834304:0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454543:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834432 00000100:00100000:2.0:1789596885.454547:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834432 00000100:00100000:2.0:1789596885.454571:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596885.454576:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984834432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596885.454607:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984834432:12345-0@lo:400:kworker.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.454613:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596885.454635:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984834432:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984834048:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596885.456105:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984834560:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456132:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596885.456193:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984833536 00000100:00100000:1.0:1789596885.456199:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984833536 00000100:00100000:1.0:1789596885.456244:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834048 00000100:00100000:1.0:1789596885.456247:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834048 00000100:00100000:1.0:1789596885.456275:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834560 00000100:00100000:1.0:1789596885.456294:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834560 00000100:00100000:1.0:1789596885.456315:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789596885.456323:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984833536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596885.456350:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e87f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2396ff16-3863-41e8-8748-2ac67b0298b6+21:13163:x1876527961718016:12345-192.168.202.16@tcp:35:umount.0 Request processed in 2793us (2901us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789596885.456371:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984833536:12345-0@lo:400:kworker.0 Request processed in 49us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596885.456378:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789596885.456393:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789596885.456399:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984834048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456421:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984834048:12345-0@lo:400:kworker.0 Request processed in 22us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596885.456427:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789596885.456436:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789596885.456441:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456460:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984834560:12345-0@lo:400:kworker.0 Request processed in 20us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596885.456466:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00080000:1.0:1789596885.456486:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596885.456500:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1789596885.456522:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984833536:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456536:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984834048:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.456549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984834560:0@lo:400:kworker.0 00000100:00100000:1.0:1789596885.459837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596885.460170:0:14969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961718272 00000100:00100000:0.0:1789596885.460186:0:14969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961718272 00000100:00100000:0.0:1789596885.460247:0:14969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789596885.460281:0:14969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+21:13163:x1876527961718272:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:0.0:1789596885.460730:0:14969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+22:13163:x1876527961718272:12345-192.168.202.16@tcp:35:umount.0 Request processed in 449us (914us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789596885.460738:0:14969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:3.0:1789596885.464959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596885.465017:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596885.465051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596885.465166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961718528 00000100:00100000:0.0:1789596885.465185:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961718528 00000100:00100000:3.0:1789596885.465245:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596885.465468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961718784 00000100:00100000:2.0:1789596885.465474:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961718784 00000100:00100000:0.0:1789596885.467199:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961718656 00000100:00100000:1.0:1789596885.467224:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:0.0:1789596885.467224:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961718656 00000100:00100000:1.0:1789596885.467253:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+15:2409:x1876527961718528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789596885.467284:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00010000:00010000:1.0:1789596885.467285:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789596885.467296:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+15:2409:x1876527961718784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596885.467307:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596885.467347:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbe9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077e0 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.467347:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833ddc00/0x7b5398e289bbebdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078b9 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.467388:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596885.467389:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596885.467502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961718400 00000100:00100000:3.0:1789596885.467508:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961718400 00000100:00100000:3.0:1789596885.467934:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:3.0:1789596885.467950:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2405:x1876527961718400:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:3.0:1789596885.468069:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbecdf 00000100:00080000:3.0:1789596885.468082:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c7e853fa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596885.468151:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789596885.468228:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+13:2409:x1876527961718784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 932us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596885.468238:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789596885.468267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789596885.468277:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+12:2409:x1876527961718656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596885.468288:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596885.468304:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81671600/0x7b5398e289bbe904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077a1 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.468320:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596885.468438:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454a6744-d65e-403d-97e2-e8496b673d4c+11:2409:x1876527961718528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1195us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596885.468447:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00080000:2.0:1789596885.468488:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596885.468522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596885.475754:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2409:x1876527961718656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7458us (10681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596885.475791:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789596885.475942:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2396ff16-3863-41e8-8748-2ac67b0298b6+2:2405:x1876527961718400:12345-192.168.202.16@tcp:9:umount.0 Request processed in 7994us (10693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596885.475956:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:2.0:1789596885.487346:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596885.487455:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961719168 00000100:00100000:3.0:1789596885.487471:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961719168 00000100:00100000:3.0:1789596885.487613:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1789596885.487637:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+7:2405:x1876527961719168:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:3.0:1789596885.487722:0:8436:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbef55 00000020:00010000:3.0:1789596885.487734:0:8436:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7ebfa99000: total 0 00000100:00080000:3.0:1789596885.487740:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa9d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596885.487818:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1789596885.487836:0:7461:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7ebfa99000: total 0 00010000:00010000:0.0:1789596885.487911:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7ebfa99000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789596885.488163:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae776bb/0x7b5398e289bbf30d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07aa3 expref: 5 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596885.488186:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2396ff16-3863-41e8-8748-2ac67b0298b6+4:2405:x1876527961719168:12345-192.168.202.16@tcp:9:umount.0 Request processed in 560us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596885.488196:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00010000:00010000:0.0:1789596885.488207:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bbf9ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c7f expref: 4 pid: 9893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.488226:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7ebfa99000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789596885.488244:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596885.488247:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596885.488250:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596885.493135:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596885.497506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596885.497914:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961720192 00000100:00100000:3.0:1789596885.497929:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961720192 00000100:00100000:3.0:1789596885.498111:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 257 00000100:00100000:3.0:1789596885.498124:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+22:2405:x1876527961720192:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:3.0:1789596885.498321:0:8967:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe912 00000020:00010000:3.0:1789596885.498341:0:8967:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7d83c28000: total 0 00000100:00080000:3.0:1789596885.498348:0:8967:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c2a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596885.498387:0:8967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789596885.498581:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2396ff16-3863-41e8-8748-2ac67b0298b6+21:2405:x1876527961720192:12345-192.168.202.16@tcp:39:umount.0 Request processed in 458us (1089us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789596885.498590:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 257 00000020:00010000:0.0:1789596885.498721:0:6508:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7d83c28000: total 0 00010000:00010000:0.0:1789596885.498797:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7d83c28000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789596885.499109:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7e993a8c00) 00010000:00010000:0.0:1789596885.499114:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596885.499125:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd000/0x7b5398e289bbec3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078c7 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499259:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:0.0:1789596885.499263:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596885.499268:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81671400/0x7b5398e289bbf8af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c32 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499284:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596885.499287:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596885.499307:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dca00/0x7b5398e289bbf1ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a56 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499323:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596885.499326:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789596885.499330:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd600/0x7b5398e289bbf384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07abf expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499343:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:0.0:1789596885.499345:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789596885.499348:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bbecb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078e3 expref: 16 pid: 8967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499360:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596885.499363:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596885.499366:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbf2ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a8e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499377:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c7e92a40800) 00010000:00010000:0.0:1789596885.499379:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789596885.499383:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bbf2f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07a9c expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499396:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c7d82471100) 00010000:00010000:0.0:1789596885.499398:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596885.499402:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dbe00/0x7b5398e289bbefb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e079bc expref: 13 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499416:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:0.0:1789596885.499421:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596885.499426:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743200/0x7b5398e289bbf98f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c6a expref: 12 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499439:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39e00) 00010000:00010000:0.0:1789596885.499442:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596885.499445:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bbec5a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078ce expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499459:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c7eb0e95700) 00010000:00010000:0.0:1789596885.499462:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789596885.499465:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743e00/0x7b5398e289bbf9b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c78 expref: 10 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499480:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c7eb9a7fd00) 00010000:00010000:0.0:1789596885.499482:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596885.499486:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bbf671 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07b98 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499503:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:0.0:1789596885.499505:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596885.499509:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd800/0x7b5398e289bbf368 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ab8 expref: 8 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596885.499519:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7d83c28000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789596885.499539:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596885.499541:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596885.499544:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596885.508261:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789596885.508941:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596885.509029:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961720320 00000100:00100000:2.0:1789596885.509042:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961720320 00000100:00100000:2.0:1789596885.509138:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 258 00000100:00100000:2.0:1789596885.509155:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+5:2405:x1876527961720320:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789596885.509218:0:11184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe919 00000100:00080000:2.0:1789596885.509247:0:11184:0:(import.c:65:import_set_state_nolock()) ffff9c7d837d4000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789596885.509253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1789596885.509302:0:11184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789596885.509563:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2396ff16-3863-41e8-8748-2ac67b0298b6+3:2405:x1876527961720320:12345-192.168.202.16@tcp:39:umount.0 Request processed in 412us (638us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789596885.509587:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 258 00010000:00010000:3.0:1789596885.510079:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596885.949099:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596885.949114:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596885.949267:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789596885.949277:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789596886.461177:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596886.973013:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596886.973056:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984834816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596886.973163:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596886.977558:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834816 00000100:00100000:0.0:1789596886.977584:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834816 00000100:00100000:0.0:1789596886.977707:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789596886.977721:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984834816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789596886.977772:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789596886.977902:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984834816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (4738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596886.977909:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789596886.978099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984834816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789596886.986965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596886.987030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596886.987100:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596886.987229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789596886.987279:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961720960 00000100:00100000:2.0:1789596886.987294:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961720960 00000100:00100000:2.0:1789596886.987376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 259 00000100:00100000:2.0:1789596886.987389:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+6:2405:x1876527961720960:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789596886.987444:0:6519:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbea2a 00000020:00010000:2.0:1789596886.987455:0:6519:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7d83c1d000: total 0 00000100:00080000:2.0:1789596886.987462:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c1b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789596886.987494:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1789596886.987795:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d191948b-51c9-4843-830f-05feb1db7f03+5:2405:x1876527961720960:12345-192.168.202.16@tcp:39:umount.0 Request processed in 409us (564us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789596886.987805:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 259 00000020:00010000:2.0:1789596886.987877:0:6508:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7d83c1d000: total 0 00010000:00010000:2.0:1789596886.987882:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596886.987951:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7d83c1d000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789596886.987997:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7e84ffee00) 00010000:00010000:2.0:1789596886.988002:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596886.988012:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bbf9dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c86 expref: 4 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596886.988037:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7d83c1d000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789596886.988062:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596886.988064:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596886.988088:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596886.988140:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596886.990067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961720448 00000100:00100000:1.0:1789596886.990091:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961720448 00000100:00100000:3.0:1789596886.990279:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961720704 00000100:00100000:3.0:1789596886.990286:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961720704 00000100:00100000:1.0:1789596886.990327:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961720576 00000100:00100000:1.0:1789596886.990333:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961720576 00000100:00100000:3.0:1789596886.990343:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789596886.990358:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789596886.990361:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:454a6744-d65e-403d-97e2-e8496b673d4c+12:2408:x1876527961720448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789596886.990374:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+12:2408:x1876527961720704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596886.990406:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596886.990406:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596886.990435:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743c00/0x7b5398e289bbea15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077f5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596886.990436:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bbebd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e078b2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596886.990468:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596886.990468:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596886.990616:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+10:2408:x1876527961720704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 247us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596886.990625:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789596886.990650:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789596886.990658:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb461e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+9:2408:x1876527961720576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596886.990668:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596886.990702:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbea1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07826 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596886.990712:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596886.991470:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:454a6744-d65e-403d-97e2-e8496b673d4c+8:2408:x1876527961720448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1110us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596886.991480:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789596886.991632:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb461e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454a6744-d65e-403d-97e2-e8496b673d4c+7:2408:x1876527961720576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 973us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596886.991640:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789596887.005242:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789596887.005314:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721088 00000100:00100000:0.0:1789596887.005328:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721088 00000100:00100000:0.0:1789596887.007210:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 260 00000100:00100000:0.0:1789596887.007232:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+5:2405:x1876527961721088:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:0.0:1789596887.007292:0:8967:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbea31 00000100:00080000:0.0:1789596887.007306:0:8967:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c19800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789596887.007352:0:8967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789596887.007598:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d191948b-51c9-4843-830f-05feb1db7f03+3:2405:x1876527961721088:12345-192.168.202.16@tcp:39:umount.0 Request processed in 373us (2374us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789596887.007607:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 260 00010000:00010000:1.0:1789596887.007767:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596887.013096:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596887.048461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789596887.048580:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721344 00000100:00100000:3.0:1789596887.048595:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721344 00000100:00100000:3.0:1789596887.050184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 403 00000100:00100000:3.0:1789596887.050213:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+7:2405:x1876527961721344:12345-192.168.202.16@tcp:251:umount.0 00000020:00000080:3.0:1789596887.050294:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe8ef 00000020:00010000:3.0:1789596887.050307:0:6514:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7d83c2b800: total 0 00000100:00080000:3.0:1789596887.050314:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c2d800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789596887.050424:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:454a6744-d65e-403d-97e2-e8496b673d4c+3:2405:x1876527961721344:12345-192.168.202.16@tcp:251:umount.0 Request processed in 224us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596887.050432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 403 00000020:00010000:0.0:1789596887.050640:0:7461:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7d83c2b800: total 0 00010000:00010000:0.0:1789596887.050776:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7d83c2b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789596887.050835:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bbe9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e077e7 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596887.050880:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7d83c2b800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789596887.050893:0:7461:0:(genops.c:885:class_export_put()) final put ffff9c7d83c2b800/454a6744-d65e-403d-97e2-e8496b673d4c 00010000:00010000:0.0:1789596887.050915:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596887.050918:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596887.050920:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789596887.051225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c2b800/454a6744-d65e-403d-97e2-e8496b673d4c for MGS 00000020:00000080:3.0:1789596887.051276:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c2d800 for MGS 00010000:00010000:0.0:1789596887.491144:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596888.509949:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789596888.816505:0:15056:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789596888.839042:0:15056:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789596888.839112:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.839131:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.839140:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.839148:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.839171:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789596888.839178:0:15056:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789596888.839208:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596888.839213:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789596888.839218:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789596888.839251:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e23a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789596888.839369:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596888.839379:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596888.839387:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596888.839391:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596888.839401:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596888.839409:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984834944:0@lo:39:umount.0 10000000:00010000:1.0:1789596888.839418:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596888.839423:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789596888.839425:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789596888.839428:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789596888.839456:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596888.839461:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789596888.839485:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596888.839508:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984835072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596888.839538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596888.839651:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596888.839659:0:11184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984834944 00010000:00010000:1.0:1789596888.839659:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6400/0x7b5398e289bbe997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe99e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596888.839666:0:11184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984834944 00010000:00010000:1.0:1789596888.839672:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596888.839674:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596888.839675:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596888.840464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835072 00000100:00100000:1.0:1789596888.840470:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835072 00000100:00100000:1.0:1789596888.840522:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596888.840530:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+24:3644:x1876527984835072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596888.840545:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596888.840889:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da200/0x7b5398e289bbe99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe997 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596888.840901:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596888.840946:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d576172c-8178-43f9-add9-c496dd76058d+23:3644:x1876527984835072:12345-0@lo:103:ldlm_bl.0 Request processed in 417us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596888.840961:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596888.841137:0:11184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789596888.841147:0:11184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876527984834944:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789596888.841182:0:11184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe506 00000100:00080000:3.0:1789596888.841191:0:11184:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e238000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789596888.841222:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596888.841265:0:11184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1876527984834944:12345-0@lo:39:umount.0 Request processed in 120us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596888.841272:0:11184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:3.0:1789596888.841279:0:11184:0:(genops.c:885:class_export_put()) final put ffff9c7e9e239000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1789596888.841297:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e23a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789596888.841308:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984834944:0@lo:39:umount.0 00000020:00000080:2.0:1789596888.841356:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9e239000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789596888.841411:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e9e238000 for lustre-MDT0000 00000100:00100000:0.0:1789596888.841441:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984835072:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789596888.841479:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789596888.841482:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789596888.841487:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789596888.842897:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842914:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842921:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842928:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842951:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596888.842957:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842965:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842971:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842977:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.842996:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789596888.843001:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843022:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843043:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843049:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843061:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789596888.843064:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789596888.843068:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843069:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843076:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7a00 already unused, calling callback (ffffffffc1431c20) 00010000:00010000:0.0:1789596888.843077:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596888.843080:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843083:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843090:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843090:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596888.843097:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:00010000:2.0:1789596888.843098:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596888.843100:0:15056:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:2.0:1789596888.843103:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596888.843105:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789596888.843107:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:0.0:1789596888.843130:0:15056:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789596888.843133:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789596888.843137:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1789596888.843138:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789596888.843142:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:2.0:1789596888.843143:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789596888.843149:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7eb6632000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596888.843160:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7eb6518800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789596888.843166:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596888.843166:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7ebae16000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596888.843171:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7e859ef800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:2.0:1789596888.843173:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7a00/0x7b5398e289bbe9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe9ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596888.843178:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c7d83c1d000 d191948b-51c9-4843-830f-05feb1db7f03 192.168.202.16@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789596888.843183:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:0.0:1789596888.843183:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c7d83c28000 2396ff16-3863-41e8-8748-2ac67b0298b6 192.168.202.16@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00010000:00010000:2.0:1789596888.843186:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596888.843189:0:15056:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c7eb01b3380) has exports, disconnecting them 00010000:00010000:2.0:1789596888.843192:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6000 already unused, calling callback (ffffffffc1431c20) 00000020:00080000:0.0:1789596888.843193:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7eb6632000), last request at 1789596885 00000020:00000080:0.0:1789596888.843199:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe816 10000000:00010000:2.0:1789596888.843200:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843206:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596888.843212:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789596888.843214:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5c000 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1789596888.843217:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596888.843219:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789596888.843220:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789596888.843234:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843240:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596888.843256:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843263:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6000/0x7b5398e289bbe8a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe8b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596888.843264:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7eb6632000): rc 0 00000020:00000080:0.0:1789596888.843266:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb6632000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1789596888.843272:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1789596888.843274:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7eb6518800), last request at 1789596885 00010000:00010000:2.0:1789596888.843276:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789596888.843278:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe6f0 00010000:00010000:2.0:1789596888.843282:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7c00 already unused, calling callback (ffffffffc1431c20) 00000100:00080000:0.0:1789596888.843282:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7eb651f000 : changing import state from FULL to CLOSED 10000000:00010000:2.0:1789596888.843285:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596888.843289:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7eb6518800): rc 0 00010000:00010000:2.0:1789596888.843291:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789596888.843291:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb6518800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789596888.843294:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7ebae16000), last request at 1789596643 00000020:00000080:0.0:1789596888.843297:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe5ed 00000100:00080000:0.0:1789596888.843300:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7ebae13800 : changing import state from FULL to CLOSED 10000000:00010000:2.0:1789596888.843304:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789596888.843305:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7ebae16000): rc 0 00000020:00000080:0.0:1789596888.843307:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7ebae16000/lustre-MDT0000-lwp-MDT0001_UUID 10000000:01000000:2.0:1789596888.843310:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:0.0:1789596888.843311:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7e859ef800), last request at 1789596643 10000000:01000000:2.0:1789596888.843312:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789596888.843313:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:0.0:1789596888.843314:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe5ae 00000100:00080000:0.0:1789596888.843317:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7ebae17800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789596888.843324:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:2.0:1789596888.843326:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843331:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596888.843338:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843344:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7c00/0x7b5398e289bbec0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbec14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843352:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596888.843355:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843360:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ec2052800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596888.843362:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843369:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596888.843374:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596888.843388:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596888.843390:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789596888.843392:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789596888.843405:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843411:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789596888.843416:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e859ef800): rc 0 00010000:00010000:2.0:1789596888.843417:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.843422:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbe465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe46c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1789596888.843422:0:15056:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc0dc47a93ae0 00010000:00010000:2.0:1789596888.843433:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596888.843435:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596888.843436:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596888.843441:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:2.0:1789596888.843443:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596888.843445:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789596888.843456:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984835456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596888.843515:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596888.844104:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984835200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596888.844136:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596888.844172:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596888.844178:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984835584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596888.844197:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596888.844220:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984835328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596888.844239:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596888.844266:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835456 00000100:00100000:1.0:1789596888.844274:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835456 00000100:00100000:1.0:1789596888.844322:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835200 00000100:00100000:1.0:1789596888.844325:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835200 00000100:00080000:0.0:1789596888.844336:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789596888.844337:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835584 00000100:00100000:1.0:1789596888.844339:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835584 00000100:00100000:1.0:1789596888.844348:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835328 00000100:00100000:1.0:1789596888.844351:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835328 00000100:00080000:0.0:1789596888.844354:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5585800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789596888.844365:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789596888.844373:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+26:3647:x1876527984835456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596888.844388:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596888.844405:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbec14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbec0d expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596888.844433:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596888.844444:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789596888.844467:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6632000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789596888.844470:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+25:3647:x1876527984835456:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596888.844477:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789596888.844492:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789596888.844498:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+24:3645:x1876527984835200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596888.844505:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1789596888.844511:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6518800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1789596888.844513:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670400/0x7b5398e289bbe9ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe9a5 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596888.844522:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1789596888.844530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebae16000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789596888.844544:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d576172c-8178-43f9-add9-c496dd76058d+23:3645:x1876527984835200:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000020:00000080:3.0:1789596888.844551:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb9b5c000 for lustre-MDT0000 00000100:00100000:1.0:1789596888.844551:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:3.0:1789596888.844556:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb651f000 for lustre-MDT0000 00000020:00000080:3.0:1789596888.844559:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ebae13800 for lustre-MDT0000 00000100:00100000:2.0:1789596888.844674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d576172c-8178-43f9-add9-c496dd76058d:3647:1876527984835456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596888.844714:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789596888.844721:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+22:3645:x1876527984835584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596888.844729:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596888.844739:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510400/0x7b5398e289bbe46c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe465 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.844747:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596888.844779:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+21:3645:x1876527984835584:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596888.844785:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789596888.844914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789596888.844920:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+20:3646:x1876527984835328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596888.844925:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596888.844933:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7e00/0x7b5398e289bbe8b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe8a9 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596888.844939:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596888.844965:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d576172c-8178-43f9-add9-c496dd76058d+19:3646:x1876527984835328:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596888.844971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596888.844991:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984835328:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789596888.845098:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789596888.845103:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1789596888.845121:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596888.845173:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984835712:0@lo:39:umount.0 00000100:00080000:3.0:1789596888.845182:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789596888.845193:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7e85984800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789596888.845201:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789596888.845203:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00100000:1.0:1789596888.845208:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789596888.845220:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596888.845236:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984835840:0@lo:9:umount.0 00000100:00100000:1.0:1789596888.845260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596888.845295:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984835584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596888.845302:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984835200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596888.845328:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835712 00000100:00100000:1.0:1789596888.845333:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835712 00000100:00100000:1.0:1789596888.845366:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789596888.845373:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876527984835712:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789596888.845414:0:6525:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe648 00000100:00080000:3.0:1789596888.845415:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789596888.845424:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9c7eb64fe800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789596888.845425:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000001:00000004:1.0:1789596888.845448:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000020:00080000:3.0:1789596888.845463:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c7eb01b3380) has no exports 00000100:00100000:2.0:1789596888.845891:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835840 00000100:00100000:2.0:1789596888.845897:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835840 00000100:00100000:2.0:1789596888.845955:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789596888.845964:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1876527984835840:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789596888.845982:0:14227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe7a6 00000100:00080000:2.0:1789596888.845990:0:14227:0:(import.c:65:import_set_state_nolock()) ffff9c7e83d74800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789596888.846008:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1789596888.846042:0:14227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789596888.846127:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3643:x1876527984835840:12345-0@lo:9:umount.0 Request processed in 165us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596888.846132:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1789596888.846145:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596888.846150:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596888.846229:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3643:x1876527984835712:12345-0@lo:39:umount.0 Request processed in 856us (1018us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789596888.846236:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789596888.846317:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984835968:0@lo:9:umount.0 00000100:00100000:1.0:1789596888.846349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789596888.846420:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e85984800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789596888.846438:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789596888.846440:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596888.846444:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984835840:0@lo:9:umount.0 00000100:00080000:1.0:1789596888.846459:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5585800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789596888.846464:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984835712:0@lo:39:umount.0 00000100:00100000:2.0:1789596888.846518:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984835968 00000100:00100000:2.0:1789596888.846522:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984835968 00000100:00080000:3.0:1789596888.846573:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596888.846612:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789596888.846622:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876527984835968:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789596888.846644:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe8da 00000100:00080000:0.0:1789596888.846652:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c1a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789596888.846939:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789596888.847080:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3643:x1876527984835968:12345-0@lo:9:umount.0 Request processed in 460us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596888.847087:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789596888.847090:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789596888.847121:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789596888.847136:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789596888.847192:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596888.847196:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984835968:0@lo:9:umount.0 00000020:00080000:3.0:1789596888.851256:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c7eb01b3380) has no exports 00000020:00000080:3.0:1789596888.894532:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe4c0 00000020:00000080:3.0:1789596888.894553:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb9914000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789596888.894579:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789596888.894728:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9914000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789596888.894804:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596888.894818:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789596888.894843:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c7eb98bb380) has no exports 00000020:00000080:2.0:1789596888.895509:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe4b9 00000020:00000080:2.0:1789596888.895518:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb98c1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789596888.895600:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb98c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789596888.895669:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596888.895934:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789596888.895938:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e8440a800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789596888.895941:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e8440a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789596888.895950:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1789596889.023209:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596889.023239:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984836096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789596889.023340:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596889.023431:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836096 00000100:00100000:2.0:1789596889.023442:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836096 00000100:00100000:2.0:1789596889.023482:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789596889.023490:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876527984836096:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789596889.023498:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789596889.023539:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876527984836096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (200us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789596889.023545:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:02020000:2.0:1789596889.023583:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789596889.046078:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789596889.046089:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789596889.046093:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789596889.064936:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596889.064954:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 218 00000100:00080000:2.0:1789596889.064972:0:3644:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c7eb5586000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596889.065102:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb0c16a00 x1876527984836224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596889.065705:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984836224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789596889.065806:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596889.069320:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836224 00000100:00100000:2.0:1789596889.069397:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836224 00000100:00100000:2.0:1789596889.069512:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789596889.069521:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984836224:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789596889.069543:0:6524:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789596889.082229:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984836224:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 12697us (16412us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789596889.082246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1789596889.082733:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596889.082752:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596889.082759:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984836224:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1789596889.541515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596890.046783:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984836352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789596890.047108:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.047347:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836352 00000100:00100000:2.0:1789596890.047357:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836352 00000100:00100000:2.0:1789596890.047423:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789596890.047432:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984836352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789596890.047468:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789596890.047533:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984836352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596890.047540:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1789596890.047713:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596890.047879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984836352:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789596890.557116:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596890.557627:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596890.557666:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984836480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596890.557791:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789596890.558346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596890.558351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789596890.558355:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596890.558363:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1789596890.558368:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789596890.558386:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c7eb5586000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596890.558413:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d825f7100 x1876527984836736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596890.558604:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984837120:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.558648:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.558726:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789596890.558733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984836992:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.558760:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.558781:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984837504:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.558803:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.559077:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837120 00000100:00100000:2.0:1789596890.559088:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837120 00000100:00100000:2.0:1789596890.559161:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836992 00000100:00100000:2.0:1789596890.559165:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836992 00000100:00100000:2.0:1789596890.559180:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837504 00000100:00100000:2.0:1789596890.559183:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837504 00000100:00100000:2.0:1789596890.559223:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789596890.559232:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984837120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.559286:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984837120:12345-0@lo:400:kworker.0 Request processed in 55us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596890.559293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789596890.559310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789596890.559316:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984837504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.559345:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984837504:12345-0@lo:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596890.559350:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789596890.559361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789596890.559365:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1876527984836992:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789596890.559371:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789596890.559576:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1876527984836992:12345-0@lo:400:kworker.0 Request processed in 207us (814us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789596890.559583:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789596890.559608:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984836608:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.559641:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.559794:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984837248:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.559823:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596890.560003:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837248 00000100:00100000:3.0:1789596890.560019:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837248 00000100:00100000:3.0:1789596890.560057:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596890.560065:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984837248:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789596890.560169:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789596890.560187:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984836864:0@lo:400:kworker.0 00000100:00100000:0.0:1789596890.561419:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836480 00000100:00100000:0.0:1789596890.561434:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836480 00000100:00100000:0.0:1789596890.561520:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789596890.561531:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984836480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596890.561566:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789596890.564615:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984837248:12345-0@lo:400:kworker.0 Request processed in 4541us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596890.564630:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596890.564734:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836608 00000100:00100000:3.0:1789596890.564744:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836608 00000100:00100000:3.0:1789596890.564788:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789596890.564796:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:3644:x1876527984836608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596890.564863:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d576172c-8178-43f9-add9-c496dd76058d+19:3644:x1876527984836608:12345-0@lo:400:kworker.0 Request processed in 68us (5222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596890.564884:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:3.0:1789596890.564948:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789596890.564954:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789596890.564959:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789596890.570001:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984837248:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.570070:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d576172c-8178-43f9-add9-c496dd76058d:3644:1876527984836608:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.570181:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984836736:0@lo:38:kworker.0 00000100:00100000:2.0:1789596890.570258:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789596890.570334:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596890.570351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836736 00000100:00100000:2.0:1789596890.570359:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836736 00000100:00100000:2.0:1789596890.570407:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789596890.570415:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984836736:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789596890.570432:0:6525:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789596890.576251:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.576321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984836864 00000100:00100000:1.0:1789596890.576331:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984836864 00000100:00100000:1.0:1789596890.576380:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789596890.576388:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1876527984836864:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789596890.576397:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789596890.576442:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1876527984836864:12345-0@lo:400:kworker.0 Request processed in 54us (198us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789596890.576449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:1.0:1789596890.576494:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789596890.576500:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789596890.576504:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789596890.576509:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596890.576514:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 218 00000100:00080000:1.0:1789596890.576525:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596890.576557:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb67b5880 x1876527984837632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596890.576618:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984836864:0@lo:400:kworker.0 00000100:00100000:1.0:1789596890.576636:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984837632:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789596890.576669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.576725:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984837376:0@lo:400:kworker.0 00000100:00100000:1.0:1789596890.576752:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.576773:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837632 00000100:00100000:1.0:1789596890.576777:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837632 00000100:00100000:1.0:1789596890.576795:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837376 00000100:00100000:1.0:1789596890.576797:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837376 00000100:00100000:1.0:1789596890.576811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789596890.576815:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984837632:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789596890.576832:0:6519:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789596890.576864:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984837632:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 48us (194us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789596890.576870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789596890.576884:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789596890.577177:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1876527984837376:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789596890.577190:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789596890.577217:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1876527984837376:12345-0@lo:400:kworker.0 Request processed in 327us (465us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789596890.577224:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789596890.577257:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596890.577261:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596890.577265:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984837632:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1789596890.577289:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789596890.577300:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789596890.577303:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789596890.577307:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596890.577310:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 261 00000100:00080000:1.0:1789596890.577317:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7eb6634000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596890.577332:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b7800 x1876527984837760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596890.577348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984837376:0@lo:400:kworker.0 00000100:00100000:1.0:1789596890.577372:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984837760:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789596890.577396:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.577419:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837760 00000100:00100000:1.0:1789596890.577423:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837760 00000100:00100000:1.0:1789596890.577441:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789596890.577445:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984837760:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789596890.577453:0:6519:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789596890.577480:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984837760:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33us (83us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789596890.577485:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1789596890.577505:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596890.577509:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596890.577512:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984837760:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1789596890.581719:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596890.581733:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 238 00000100:00080000:3.0:1789596890.581751:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7d82063000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596890.581817:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d825f4700 x1876527984837888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596890.582640:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984836992:0@lo:400:kworker.0 00000100:00100000:3.0:1789596890.582670:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984837888:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789596890.582857:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984836480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 21324us (25062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596890.582871:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789596890.582974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984836480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789596890.583142:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789596890.583203:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f4e00 x1876527984837504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596890.583215:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984837504:0@lo:400:kworker.0 00010000:00080000:3.0:1789596890.583227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f4380 x1876527984837120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596890.583234:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984837120:0@lo:400:kworker.0 00000100:00100000:0.0:1789596890.583881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984837888 00000100:00100000:0.0:1789596890.584002:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984837888 00000100:00100000:0.0:1789596890.584068:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789596890.584077:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984837888:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789596890.584096:0:6520:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789596890.584386:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984837888:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 307us (1243us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789596890.584394:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1789596890.584500:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596890.584506:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789596890.584510:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984837888:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789596890.602312:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984836736:12345-0@lo:38:kworker.0 Request processed in 31882us (32039us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789596890.602352:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1789596890.602946:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596890.602955:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789596890.602961:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984836736:0@lo:38:kworker.0 00000001:00100000:0.0:1789596891.072034:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789596891.072047:0:9514:0:(genops.c:885:class_export_put()) final put ffff9c7d83c1a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789596891.072072:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:0.0:1789596891.072075:0:9514:0:(genops.c:885:class_export_put()) final put ffff9c7e853fe000/2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:1.0:1789596891.072365:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789596891.072438:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e853fe000/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-OST0001 00000020:00000080:1.0:1789596891.072461:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c1a800 for lustre-OST0001 00000020:00000080:1.0:1789596891.072478:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e853fa800 for lustre-OST0001 00000001:00100000:2.0:1789596891.080565:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789596891.080592:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789596891.080598:0:7450:0:(genops.c:885:class_export_put()) final put ffff9c7eb64fc800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789596891.080626:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000001:00080000:2.0:1789596891.080632:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789596891.080635:0:7450:0:(genops.c:885:class_export_put()) final put ffff9c7d83c1f000/d191948b-51c9-4843-830f-05feb1db7f03 00000001:00100000:2.0:1789596891.080641:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000001:00080000:2.0:1789596891.080648:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789596891.080650:0:7450:0:(genops.c:885:class_export_put()) final put ffff9c7d837d1000/2396ff16-3863-41e8-8748-2ac67b0298b6 00000001:00100000:0.0:1789596891.080920:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789596891.080926:0:6498:0:(genops.c:885:class_export_put()) final put ffff9c7e859ef800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789596891.080937:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d191948b-51c9-4843-830f-05feb1db7f03 00000001:00080000:0.0:1789596891.080943:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789596891.080945:0:6498:0:(genops.c:885:class_export_put()) final put ffff9c7d83c1d000/d191948b-51c9-4843-830f-05feb1db7f03 00000001:00100000:0.0:1789596891.080957:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000001:00080000:0.0:1789596891.080973:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789596891.080981:0:6498:0:(genops.c:885:class_export_put()) final put ffff9c7d83c28000/2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:3.0:1789596891.081721:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb64fc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789596891.081822:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c1f000/d191948b-51c9-4843-830f-05feb1db7f03 for lustre-MDT0001 00000020:00000080:3.0:1789596891.081855:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d837d1000/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-MDT0001 00000020:00000080:3.0:1789596891.081919:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789596891.081950:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c1d000/d191948b-51c9-4843-830f-05feb1db7f03 for lustre-MDT0000 00000020:00000080:3.0:1789596891.081980:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c28000/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-MDT0000 00000020:00000080:3.0:1789596891.082022:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb64fe800 for lustre-MDT0001 00000020:00000080:3.0:1789596891.082028:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c19800 for lustre-MDT0001 00000020:00000080:3.0:1789596891.082031:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d837d4000 for lustre-MDT0001 00000020:00000080:3.0:1789596891.082036:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ebae17800 for lustre-MDT0000 00000020:00000080:3.0:1789596891.082039:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c1b800 for lustre-MDT0000 00000020:00000080:3.0:1789596891.082041:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c2a800 for lustre-MDT0000 00000001:00100000:1.0:1789596891.082627:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789596891.082635:0:8430:0:(genops.c:885:class_export_put()) final put ffff9c7e83d71800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789596891.082710:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:1.0:1789596891.082712:0:8430:0:(genops.c:885:class_export_put()) final put ffff9c7ebfa99000/2396ff16-3863-41e8-8748-2ac67b0298b6 00000020:00000080:0.0:1789596891.082764:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83d71800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789596891.082813:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e83d74800 for lustre-OST0000 00000020:00000080:3.0:1789596891.084168:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebfa99000/2396ff16-3863-41e8-8748-2ac67b0298b6 for lustre-OST0000 00000020:00000080:3.0:1789596891.084368:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ebfa9d000 for lustre-OST0000 00010000:00010000:3.0:1789596891.582518:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596892.609269:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596893.628998:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596894.653206:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789596894.973060:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d8337b720 - data ffff9c7e9e6700d8/ffff9c7eb66b2c00 00000020:01000000:0.0:1789596894.973285:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7eb9a3e4e0 - data ffff9c7e9e54f0d8/ffff9c7e912ef800 00000001:00000004:0.0:1789596894.986294:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789596895.061734:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789596895.061744:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789596895.061764:0:15056:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c7d837b4a80 x1876527984835712/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789596898 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596895.061797:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789596895.067834:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789596895.067846:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789596895.067874:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789596895.067877:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789596895.072763:0:8519:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789596895.072774:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789596895.072792:0:8519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789596895.073526:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789596895.073541:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1789596895.073569:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789596895.073572:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789596895.073931:0:9888:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789596895.073935:0:9888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789596895.073945:0:9888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789596895.076222:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe488 00000020:00000080:0.0:1789596895.076238:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e859ee800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789596895.079879:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789596895.087922:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe49d 00000020:00000080:1.0:1789596895.087940:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e8440c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789596895.087957:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789596895.087962:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596895.087982:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789596895.087988:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c7eb01b4d40) has no exports 00000020:00000080:3.0:1789596895.088253:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e8440c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789596895.088460:0:15056:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789596895.088471:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe8d3 00000020:00000080:1.0:1789596895.088476:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7d83c2e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789596895.088490:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789596895.088501:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596895.088511:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789596895.088514:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9c7d820c99c0) has no exports 00000020:00000080:1.0:1789596895.088522:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe8cc 00000020:00000080:1.0:1789596895.088527:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7d83188000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789596895.089228:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789596895.089234:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789596895.089240:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789596895.089249:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596895.089252:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789596895.089293:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596895.089308:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596895.089315:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe791 00000020:00000080:1.0:1789596895.089322:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb651d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789596895.089327:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789596895.089353:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596895.089358:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789596895.089360:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9c7ebf990000) has no exports 00000020:00000080:1.0:1789596895.089366:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe78a 00000020:00000080:1.0:1789596895.089370:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb651a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789596895.090146:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c2e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789596895.090160:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83188000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789596895.090165:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d8318a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789596895.090173:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7d8365b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789596895.090175:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8365b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789596895.090181:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789596895.090288:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb651d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789596895.090294:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb651a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789596895.090655:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789596895.090660:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789596895.090665:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789596895.090671:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596895.090673:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789596895.090913:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596895.090928:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789596895.090951:0:15056:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789596895.090961:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe641 00000020:00000080:1.0:1789596895.090981:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e83d70800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789596895.091463:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e85984800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789596895.091473:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7eb651d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789596895.091477:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb651d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789596895.091485:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789596895.091673:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789596895.091824:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83d70800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789596895.091868:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596895.091878:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789596895.091883:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c7e9e358000) has no exports 00000020:00000080:1.0:1789596895.091891:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe63a 00000020:00000080:1.0:1789596895.091898:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7eb5587800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789596895.092111:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5587800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789596895.096820:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789596895.096833:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789596895.096838:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789596895.096851:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789596895.096920:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596895.096933:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596895.097078:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596895.097084:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596895.097092:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e859ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789596895.097100:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859ec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789596895.097122:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596895.097276:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe4a4 00000020:00000080:0.0:1789596895.097288:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e84409800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789596895.097295:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789596895.097301:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596895.097307:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789596895.097312:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c7eb01b0000) has no exports 00000020:00000080:0.0:1789596895.097336:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596895.097340:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789596895.097345:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe4ab 00000020:00000080:0.0:1789596895.097367:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e84409000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789596895.097376:0:15056:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e867d5800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789596895.097379:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e867d5800 3 00000020:01000004:0.0:1789596895.097382:0:15056:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7e867d5800 from lustre-MDT0000 00000020:00000080:0.0:1789596895.097405:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596895.097409:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789596895.097411:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e859e8000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789596895.097413:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859e8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789596895.097421:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789596895.097454:0:15056:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789596895.097459:0:15056:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789596895.097462:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789596895.097465:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596895.097469:0:15056:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789596895.097477:0:15056:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c7ea64e7800 d576172c-8178-43f9-add9-c496dd76058d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596895.097484:0:15056:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c7eb01b19c0) has exports, disconnecting them 00000020:00080000:0.0:1789596895.097488:0:15056:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c7ea64e7800), last request at 1789596622 00000020:00000080:0.0:1789596895.097506:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe449 00000020:00010000:0.0:1789596895.097509:0:15056:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7ea64e7800: total 2 00000100:00080000:0.0:1789596895.097514:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9c7ea64e7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789596895.097530:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7ea64e7800): rc 0 00000020:00080000:0.0:1789596895.097534:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c7eb01b19c0) has no exports 00000100:00100000:3.0:1789596895.097715:0:6513:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c7e9e355200:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1789596895.097862:0:6514:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c7ea65c3200:6514] 2 exiting: rc = 0 00000020:00000080:3.0:1789596895.097955:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb5585800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789596895.097964:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7e859ea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789596895.097978:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859ea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789596895.097982:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789596895.098063:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e84409800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789596895.098068:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7e859ee000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789596895.098077:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859ee000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789596895.098082:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789596895.098111:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e84409000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1789596895.103306:0:6508:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7ea64e7800: total 0 00010000:00010000:0.0:1789596895.103409:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7ea64e7800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789596895.103453:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbe974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe96d expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103480:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670000/0x7b5398e289bbe966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe95f expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103559:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c7800/0x7b5398e289bbe982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe97b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103580:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670200/0x7b5398e289bbe990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe989 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103590:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bbe545 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe53e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103603:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbe553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe54c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103615:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbebea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbebe3 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103626:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbebf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbebf1 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103635:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dae00/0x7b5398e289bbe958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe951 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103644:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb64c6600/0x7b5398e289bbec06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbebff expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103655:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81670a00/0x7b5398e289bbe86a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe863 expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103666:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbe9ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe9b3 expref: 3 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103674:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da600/0x7b5398e289bbe94a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbe943 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596895.103716:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7ea64e7800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789596895.103731:0:6508:0:(genops.c:885:class_export_put()) final put ffff9c7ea64e7800/d576172c-8178-43f9-add9-c496dd76058d 00010000:00010000:0.0:1789596895.103755:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596895.103757:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789596895.103806:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ea64e7800/d576172c-8178-43f9-add9-c496dd76058d for MGS 00000020:00000080:3.0:1789596895.103859:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ea64e7000 for MGS 00010000:00010000:0.0:1789596895.103948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596895.104942:0:6512:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c7e84c23600:6512] 0 exiting: rc = 1 00000100:00100000:3.0:1789596895.106277:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106290:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106297:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106303:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106311:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106318:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106324:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106330:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106338:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106345:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106356:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106363:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106386:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106395:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106401:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106407:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106417:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106423:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106428:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106435:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106442:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106449:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106456:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106463:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106469:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106475:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106481:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106486:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106561:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106590:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106600:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106607:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106615:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106622:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106629:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106636:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106644:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106652:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106660:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106667:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106674:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106910:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106921:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106928:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106935:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106942:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106949:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106955:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106961:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106979:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106986:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.106994:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107000:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107007:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107012:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107018:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107024:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107029:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107035:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107040:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107046:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107054:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107059:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596895.107065:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789596895.111249:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d8337b960 - data ffff9c7d81c22288/ffff9c7eb66b0c00 00000020:01000000:3.0:1789596895.111526:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7e85200ba0 - data ffff9c7e9e44a870/ffff9c7eb0c12000 00000020:00000080:3.0:1789596895.112868:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe42d 00000020:00000080:3.0:1789596895.112883:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e9192e000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789596895.113270:0:15056:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e867d5800 from MGS, refs=2 00000020:01000004:3.0:1789596895.113275:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e867d5800 2 00000020:01000004:3.0:1789596895.113278:0:15056:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7e867d5800 from MGS 00000020:00000080:3.0:1789596895.113303:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596895.113311:0:15056:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789596895.113314:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e9192c800/MGS 00000020:00000080:3.0:1789596895.113317:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9192c800/MGS for MGS 00000020:01000000:3.0:1789596895.113324:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789596895.113419:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789596895.113426:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596895.113433:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789596895.113444:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c7e9e238800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789596895.113451:0:15056:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9c7e8894cd40) has exports, disconnecting them 00000020:00080000:3.0:1789596895.113458:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c7e9e238800), last request at 1789596622 00000020:00000080:3.0:1789596895.113465:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe4f8 00000020:00080000:3.0:1789596895.113479:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e9e238800): rc 0 00000020:00000080:3.0:1789596895.113487:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e9e238800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789596895.113849:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9192e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789596895.115500:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9e238800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:0.0:1789596895.166076:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596895.166115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984838016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789596895.166199:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596895.166281:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838016 00000100:00100000:0.0:1789596895.166294:0:10297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838016 00000100:00100000:0.0:1789596895.166373:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789596895.166382:0:10297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984838016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596895.166411:0:10297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789596895.166458:0:10297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984838016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596895.166465:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1789596895.166490:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596895.166536:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984838016:0@lo:13:osp-pre-0-1.0 00010000:01000000:3.0:1789596895.196209:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789596895.196222:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789596895.196229:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789596895.196242:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789596895.196588:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596895.196600:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789596895.196610:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e867d5800 1 00000020:00000080:3.0:1789596895.196621:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe41f 00000020:00000080:3.0:1789596895.196634:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e91929800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789596895.196859:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e9e23a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789596895.196870:0:36:0:(genops.c:885:class_export_put()) final put ffff9c7e9e23b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789596895.196873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9e23b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789596895.196885:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1789596895.197228:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789596895.197248:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596895.197256:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789596895.197262:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c7e8894b380) has no exports 00000020:00000080:0.0:1789596895.203157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e91929800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789596895.245448:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596895.245462:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789596895.245469:0:15056:0:(genops.c:885:class_export_put()) final put ffff9c7e867d1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789596895.245474:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e867d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789596895.245481:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789596895.245630:0:15056:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7e867d0000 00000020:02000400:3.0:1789596895.245737:0:15056:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1789596895.679147:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596895.679183:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984838144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789596895.679276:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596895.680652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838144 00000100:00100000:0.0:1789596895.680672:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838144 00000100:00100000:0.0:1789596895.680818:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789596895.680831:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984838144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789596895.680904:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789596895.681017:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984838144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 188us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596895.681025:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789596895.681347:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984838144:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789596895.681650:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596895.681659:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789596895.681665:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596895.681898:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596895.681955:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984838272:0@lo:400:kworker.0 00000400:00000100:0.0:1789596895.682022:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527984838272 offset 0 length 224: 4 00010000:00010000:0.0:1789596895.682259:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789596895.682363:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1789596895.682372:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789596895.682413:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c7eb5586000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596895.690353:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b5f80 x1876527984838400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596895.690404:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596895.690411:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789596895.690414:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596895.690421:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1789596895.690428:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789596895.690448:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596895.690473:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b6300 x1876527984838528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596895.690491:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984838400:0@lo:38:kworker.0 00000100:00100000:2.0:1789596895.690611:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596895.690669:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984838528:0@lo:38:kworker.0 00000100:00080000:1.0:1789596895.690707:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596895.690714:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789596895.690717:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596895.690724:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1789596895.690730:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1789596895.690743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789596895.690756:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7d82063000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596895.690779:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b6a00 x1876527984838656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596895.690807:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838400 00000100:00100000:2.0:1789596895.690816:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838400 00000100:00080000:1.0:1789596895.690852:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596895.690857:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789596895.690860:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789596895.690864:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1789596895.690869:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1789596895.690875:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1789596895.690881:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984838400:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1789596895.690908:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7eb6634000 using connection 192.168.202.116@tcp/0@lo 00010000:00020000:2.0:1789596895.690914:0:6525:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789596895.690932:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4e00 x1876527984839040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596895.691029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838528 00000100:00100000:1.0:1789596895.691036:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838528 00000100:00100000:1.0:1789596895.691076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789596895.691083:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984838528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789596895.691101:0:6521:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789596895.691116:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984838400:12345-0@lo:38:kworker.0 Request processed in 234us (502us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789596895.691125:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789596895.691171:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984838528:12345-0@lo:38:kworker.0 Request processed in 85us (428us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789596895.691179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789596895.691207:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984838784:0@lo:400:kworker.0 00000100:00100000:1.0:1789596895.691243:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596895.691288:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596895.691295:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984838912:0@lo:400:kworker.0 00000100:00100000:1.0:1789596895.691321:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596895.691365:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838784 00000100:00100000:1.0:1789596895.691369:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838784 00000100:00100000:1.0:1789596895.692087:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789596895.692101:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984838784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596895.692912:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984838784:12345-0@lo:400:kworker.0 Request processed in 812us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596895.692924:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789596895.693387:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984839168:0@lo:400:kworker.0 00000100:00100000:1.0:1789596895.693439:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596895.693654:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984839168 00000100:00100000:1.0:1789596895.694373:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984839168 00000100:00100000:1.0:1789596895.694450:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789596895.694460:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984839168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596895.694938:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984839168:12345-0@lo:400:kworker.0 Request processed in 478us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596895.694947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00080000:1.0:1789596895.695411:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c7d831b7100 x1876527984838784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596895.695430:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984838784:0@lo:400:kworker.0 00010000:00080000:1.0:1789596895.695482:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c7d831b4000 x1876527984839168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596895.695558:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984839168:0@lo:400:kworker.0 00000100:00100000:1.0:1789596895.695595:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984838656:0@lo:38:kworker.0 00000100:00100000:2.0:1789596895.695609:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838912 00000100:00100000:2.0:1789596895.695637:0:14227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838912 00000100:00100000:1.0:1789596895.695666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596895.695779:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596895.695794:0:14227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596895.695922:0:14227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984838912:12345-0@lo:400:kworker.0 Request processed in 130us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596895.695929:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596895.696149:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984838912:0@lo:400:kworker.0 00000100:00080000:2.0:1789596895.696288:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789596895.696325:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984838656 00000100:00100000:2.0:1789596895.696330:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984838656 00000100:00100000:1.0:1789596895.696370:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984839040:0@lo:38:kworker.0 00000100:00100000:1.0:1789596895.696408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789596895.699558:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596895.699580:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596895.699589:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984838528:0@lo:38:kworker.0 00000100:00080000:1.0:1789596895.699610:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596895.699615:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596895.699618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984838400:0@lo:38:kworker.0 00000100:00100000:1.0:1789596895.699901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984839040 00000100:00100000:1.0:1789596895.699914:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984839040 00000100:00100000:1.0:1789596895.700235:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789596895.700250:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789596895.700262:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876527984839040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789596895.700296:0:8967:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789596895.700323:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984838656:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789596895.700337:0:6520:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789596895.700801:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876527984839040:12345-0@lo:38:kworker.0 Request processed in 539us (4390us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789596895.700809:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789596895.702997:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984838656:12345-0@lo:38:kworker.0 Request processed in 2661us (7319us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789596895.703014:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1789596895.703368:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596895.703376:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596895.703381:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984838656:0@lo:38:kworker.0 00000100:00080000:1.0:1789596895.703399:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596895.703404:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789596895.703408:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984839040:0@lo:38:kworker.0 00000040:00080000:3.0:1789596895.741646:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789596896.700926:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596897.727830:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596898.749110:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596899.773957:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596900.290496:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596900.290534:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984839296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789596900.293632:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596900.293795:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984839296 00000100:00100000:0.0:1789596900.293817:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984839296 00000100:00100000:0.0:1789596900.293941:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789596900.293956:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984839296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789596900.294014:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789596900.294147:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984839296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 195us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596900.294156:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1789596900.294188:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596900.295129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984839296:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1789596900.308166:0:15258:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789596900.327646:0:15258:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789596900.329298:0:15258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.329322:0:15258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.329352:0:15258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.329360:0:15258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.337518:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.337535:0:15258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789596900.337536:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.337557:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671e00 already unused, calling callback (ffffffffc1431c20) 10000000:01000000:0.0:1789596900.337558:0:15258:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 10000000:00010000:3.0:1789596900.337564:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.337578:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596900.337609:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596900.337615:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596900.337617:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789596900.337620:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789596900.337660:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.337666:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596900.337725:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.337733:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81671e00/0x7b5398e289bbe97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe982 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.337749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596900.337751:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596900.337753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596900.337774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984839424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596900.337841:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596900.337956:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984839424 00000100:00100000:2.0:1789596900.337964:0:7927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984839424 00000100:00100000:2.0:1789596900.338014:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789596900.338023:0:7927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876527984839424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789596900.338031:0:7927:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789596900 with bad export cookie 8886614588472943689 00000100:00100000:2.0:1789596900.345387:0:7927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876527984839424:12345-0@lo:103:ldlm_bl.0 Request processed in 7357us (7538us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789596900.345403:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789596900.345633:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789596900.345638:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789596900.345642:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789596900.347983:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596900.347994:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789596900.348004:0:15258:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789596900.348013:0:15258:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789596900.348021:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596900.348023:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789596900.348027:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789596900.358183:0:15258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358220:0:15258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358230:0:15258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358241:0:15258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358279:0:15258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596900.358309:0:15258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358317:0:15258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358323:0:15258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358330:0:15258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358344:0:15258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789596900.358350:0:15258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358356:0:15258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358362:0:15258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358367:0:15258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358385:0:15258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789596900.358391:0:15258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358397:0:15258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358409:0:15258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358414:0:15258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.358421:0:15258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789596900.358424:0:15258:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1789596900.358468:0:15258:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789596900.358473:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789596900.358477:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596900.358484:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789596900.358494:0:15258:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c7d83189800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596900.358500:0:15258:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c7eb6518000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596900.358505:0:15258:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9c7eb55799c0) has exports, disconnecting them 00000020:00080000:0.0:1789596900.358510:0:15258:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c7d83189800), last request at 1789596895 00000020:00000080:0.0:1789596900.358521:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe82b 00000100:00080000:0.0:1789596900.358547:0:15258:0:(import.c:65:import_set_state_nolock()) ffff9c7d8318c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789596900.358615:0:15258:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d83189800): rc 0 00000020:00000080:0.0:1789596900.358617:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7d83189800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789596900.358628:0:15258:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c7eb6518000), last request at 1789596895 00000020:00000080:0.0:1789596900.358632:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe705 00000100:00080000:0.0:1789596900.358638:0:15258:0:(import.c:65:import_set_state_nolock()) ffff9c7eb651a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789596900.358644:0:15258:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7eb6518000): rc 0 00000020:00000080:0.0:1789596900.358646:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb6518000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789596900.358654:0:15258:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc0dc4147bae0 00000100:00080000:0.0:1789596900.358735:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596900.358754:0:15258:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c7eb0c17100 x1876527984836096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789596905 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596900.358772:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1789596900.360112:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00080000:0.0:1789596900.364709:0:15258:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789596900.364724:0:15258:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789596900.369061:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596900.369105:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.369122:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596900.369127:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.369138:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596900.369146:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596900.370364:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596900.370386:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789596900.370392:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596900.370404:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596900.370413:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596900.370420:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789596900.370446:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1789596900.370451:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789596900.370770:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596900.370780:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789596900.370784:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:0.0:1789596900.372892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83189800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789596900.372996:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6518000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789596900.373022:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d8318c800 for lustre-MDT0001 00000020:00000080:0.0:1789596900.373027:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb651a000 for lustre-MDT0001 00000100:00080000:3.0:1789596900.373420:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.116@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789596900.373425:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789596900.373438:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d831b5500 x1876527984838272/t0(0) o400->MGC192.168.202.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789596911 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596900.374363:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789596900.374368:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789596900.374384:0:15258:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789596900.374499:0:15258:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789596900.374526:0:15258:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9a77800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789596900.374543:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789596900.374545:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789596900.374554:0:15258:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789596900.374628:0:15258:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789596900.374636:0:15258:0:(import.c:65:import_set_state_nolock()) ffff9c7d8365d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789596900.374662:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c7eb55799c0) has no exports 00000100:00100000:3.0:1789596900.374897:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d825f4700 x1876527984839424/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789596916 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789596900.374909:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789596900.374912:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789596900.374913:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1789596900.375931:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376475:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376491:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596900.376514:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376522:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7000/0x7b5398e289bbe863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe86a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376545:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596900.376550:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376557:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596900.376579:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376591:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596900.376599:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596900.376606:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789596900.376609:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789596900.376618:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789596900.376639:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:2.0:1789596900.376642:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376649:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7200/0x7b5398e289bbebff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbec06 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376657:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596900.376661:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376666:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596900.376668:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376674:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596900.376698:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596900.376710:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596900.376713:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789596900.376716:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789596900.376722:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:2.0:1789596900.376725:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376731:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbe54c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe553 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.376741:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596900.376743:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596900.376745:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596900.377240:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596900.377271:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596900.377283:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7400/0x7b5398e289bbe989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbe990 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596900.377304:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596900.377306:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596900.377309:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596900.377340:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984839552:0@lo:9:umount.0 00000100:00100000:1.0:1789596900.377446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596900.377515:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984839680:0@lo:9:umount.0 00000100:00100000:1.0:1789596900.377540:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596900.377804:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984839552 00000100:00100000:2.0:1789596900.377827:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984839552 00000100:00100000:2.0:1789596900.378033:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984839680 00000100:00100000:2.0:1789596900.378038:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984839680 00000100:00100000:1.0:1789596900.379018:0:9893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789596900.379038:0:9893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876527984839552:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789596900.379083:0:9893:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe752 00000100:00080000:1.0:1789596900.379104:0:9893:0:(import.c:65:import_set_state_nolock()) ffff9c7d82065000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789596900.379174:0:9893:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789596900.379396:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789596900.379407:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876527984839680:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789596900.379425:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe894 00000100:00080000:2.0:1789596900.379431:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c7d8365d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789596900.379474:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789596900.380406:0:9893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3643:x1876527984839552:12345-0@lo:9:umount.0 Request processed in 1363us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596900.380421:0:9893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789596900.380663:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1876527984839680:12345-0@lo:9:umount.0 Request processed in 1252us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596900.380674:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789596900.380755:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789596900.381263:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789596900.381668:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596900.381714:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 197 00000100:00080000:2.0:1789596900.381964:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9a77800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789596900.381981:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789596900.382010:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789596900.382018:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984839552:0@lo:9:umount.0 00000100:00080000:2.0:1789596900.382048:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d8365d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789596900.382064:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789596900.382066:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789596900.382070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984839680:0@lo:9:umount.0 00010000:00010000:2.0:1789596900.382118:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789596900.382943:0:3646:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff9c7e85337800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596900.383176:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e78700 x1876527984840064/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596900.383239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:3646:1876527984839424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596900.383260:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596900.383271:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d576172c-8178-43f9-add9-c496dd76058d:0:1876527984839936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596900.383317:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:3645:1876527984838272:0@lo:400:kworker.0 00000100:00100000:2.0:1789596900.383336:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596900.383342:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d576172c-8178-43f9-add9-c496dd76058d:0:1876527984839808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596900.383366:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596900.383407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984836096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596900.385988:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d576172c-8178-43f9-add9-c496dd76058d:3643:1876527984840064:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1789596900.386086:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527984840064 offset 0 length 520: 4 00000020:00080000:1.0:1789596900.399164:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c7eb55799c0) has no exports 00000020:01000000:0.0:1789596900.469493:0:15258:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d825027e0 - data ffff9c7d81d5f000/ffff9c7d83762800 00000020:01000000:0.0:1789596900.469668:0:15258:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7e92d09540 - data ffff9c7e9e59a6c0/ffff9c7eb9ba6800 00000001:00000004:0.0:1789596900.505910:0:15258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789596900.588235:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789596900.588246:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789596900.588257:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789596900.590264:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789596900.590276:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789596900.590303:0:15258:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789596900.590306:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789596900.593089:0:8505:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789596900.593101:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789596900.593119:0:8505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789596900.596161:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789596900.596172:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789596900.596212:0:15258:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789596900.596215:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789596900.596710:0:9883:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789596900.596717:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789596900.596732:0:9883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789596900.598952:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe56f 00000020:00000080:2.0:1789596900.598970:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb98c1000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789596900.600078:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb98c1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789596900.602658:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe584 00000020:00000080:0.0:1789596900.602784:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb5584000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789596900.602837:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789596900.602844:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596900.602855:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789596900.602860:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c7eb5578000) has no exports 00000004:01000000:0.0:1789596900.603083:0:15258:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789596900.603094:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe88d 00000020:00000080:0.0:1789596900.603098:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7d83658000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789596900.603889:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5584000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789596900.604023:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789596900.604087:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83658000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789596900.604101:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596900.604113:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789596900.604116:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9c7e9e3599c0) has no exports 00000020:00000080:1.0:1789596900.604127:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe886 00000020:00000080:1.0:1789596900.604132:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7d8365e000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789596900.604750:0:15258:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789596900.604757:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789596900.604761:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789596900.604768:0:15258:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596900.604771:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789596900.604806:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596900.604815:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789596900.604822:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe74b 00000020:00000080:1.0:1789596900.604827:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb9a72000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789596900.604830:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789596900.604834:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596900.604838:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789596900.604840:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9c7d820cb380) has no exports 00000020:00000080:1.0:1789596900.604844:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe744 00000020:00000080:1.0:1789596900.604846:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb9a75800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789596900.605221:0:15258:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789596900.605225:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789596900.605241:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1789596900.605245:0:15258:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789596900.605246:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789596900.605275:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596900.605280:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789596900.605296:0:15258:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789596900.605304:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe5a7 00000020:00000080:1.0:1789596900.605310:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7e859ed800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789596900.605314:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789596900.605317:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596900.605616:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8365e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789596900.605630:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d8365d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789596900.605636:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7d8365c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789596900.605638:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8365c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789596900.605643:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789596900.605774:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9a72000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789596900.605779:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9a75800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789596900.605783:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb9a77800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789596900.605787:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7ebb0f1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789596900.605790:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebb0f1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789596900.605794:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789596900.605821:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859ed800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789596900.605950:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789596900.605955:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c7eb557b380) has no exports 00000020:00000080:1.0:1789596900.605962:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe5a0 00000020:00000080:1.0:1789596900.605967:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb5583800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789596900.608216:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5583800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789596900.608902:0:15258:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789596900.608909:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596900.608914:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789596900.608935:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789596900.608990:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596900.609003:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789596900.609036:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596900.609054:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789596900.609060:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7e85981800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789596900.609063:0:15258:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85981800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789596900.609081:0:15258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789596900.609276:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe58b 00000020:00000080:0.0:1789596900.609285:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb5584800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789596900.609291:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789596900.609295:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596900.609300:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789596900.609304:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9c7eb557cd40) has no exports 00000020:00000080:0.0:1789596900.609337:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596900.609341:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789596900.609346:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe592 00000020:00000080:0.0:1789596900.609350:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb5581800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789596900.609358:0:15258:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7eb9a66000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789596900.609361:0:15258:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb9a66000 2 00000020:01000004:0.0:1789596900.609364:0:15258:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7eb9a66000 from lustre-MDT0001 00000020:00000080:0.0:1789596900.609380:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596900.609384:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789596900.609386:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7e85983800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789596900.609389:0:15258:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85983800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789596900.609395:0:15258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789596900.609422:0:15258:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789596900.609426:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789596900.609429:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596900.609432:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789596900.609440:0:15258:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c7e9d7d5800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596900.609458:0:15258:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9c7eb98b99c0) has exports, disconnecting them 00000020:00080000:0.0:1789596900.609463:0:15258:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c7e9d7d5800), last request at 1789596643 00000020:00000080:0.0:1789596900.609468:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe5e6 00000020:00080000:0.0:1789596900.609483:0:15258:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e9d7d5800): rc 0 00000020:00000080:0.0:1789596900.609495:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7e9d7d5800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789596900.610248:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb5586000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789596900.610258:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7eb5580800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789596900.610260:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5580800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789596900.610272:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789596900.610421:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5584800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789596900.610426:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7eb5582000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789596900.610428:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5582000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789596900.610432:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789596900.610648:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5581800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789596900.610654:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d7d5800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789596900.632963:0:15258:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789596900.632981:0:15258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789596900.632988:0:15258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789596900.633013:0:15258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789596900.633058:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb9b5f800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789596900.633341:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596900.633353:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789596900.633359:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb9b5d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789596900.633364:0:15258:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9b5d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789596900.633377:0:15258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789596900.633502:0:15258:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb9a66000 1 00000020:00000080:2.0:1789596900.633512:0:15258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe522 00000020:00000080:2.0:1789596900.633524:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7e9d663000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789596900.633535:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789596900.633543:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d663000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789596900.633570:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596900.633577:0:15258:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789596900.633582:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c7eb98b8000) has no exports 00000020:00000080:2.0:1789596900.722286:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596900.722303:0:15258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789596900.722312:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7eb9a63800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789596900.722388:0:15258:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9a63800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789596900.722397:0:15258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789596900.722615:0:15258:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7eb9a63000 00000020:01000000:2.0:1789596900.722645:0:15258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789596900.722650:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596900.722656:0:15258:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789596900.722661:0:15258:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c7e889499c0) has no exports 00000100:00100000:0.0:1789596900.723160:0:6521:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9c7e86246a00:6521] 2 exiting: rc = 0 00000100:00100000:0.0:1789596900.723308:0:6519:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9c7e96646000:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1789596900.728724:0:8967:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9c7eb64d0a00:8967] 3 exiting: rc = 0 00000100:00100000:3.0:1789596900.733284:0:11184:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9c7d83778400:11184] 4 exiting: rc = 0 00000100:00100000:1.0:1789596900.733652:0:6520:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9c7ea03a6400:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1789596900.734093:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734105:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734111:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734118:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734124:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734131:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734137:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734143:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734149:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734154:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734161:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734166:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734173:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734187:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734197:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734203:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734209:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734215:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734220:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734227:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734246:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734252:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734259:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734265:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734272:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734278:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734284:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734290:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734297:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734302:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734309:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734315:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734322:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734331:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734344:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734353:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734360:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734368:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734375:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734380:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734386:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734392:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734398:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734405:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734412:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734419:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734425:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734431:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734437:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734959:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734965:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734972:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734978:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734983:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.734988:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735004:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735009:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735013:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735019:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735025:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735031:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735037:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735044:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.735050:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596900.747826:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c7e84cbf400:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1789596900.748624:0:14969:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9c7d83772800:14969] 2 exiting: rc = 0 00000100:00100000:0.0:1789596900.748792:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c7e84cbfe00:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1789596900.750314:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750323:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750330:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750336:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750343:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750350:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750357:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750362:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750369:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750374:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750380:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750387:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750395:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750401:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750407:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750412:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750417:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750422:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750427:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750432:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750437:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750453:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750459:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750476:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750481:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750487:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750492:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750497:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750502:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750506:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750512:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750516:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750521:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750525:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750530:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750534:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750539:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750544:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750548:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750553:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750557:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750562:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750567:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750572:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750577:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750581:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750586:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750591:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750595:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750600:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750604:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750609:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750613:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750618:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750622:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750627:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750631:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750635:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750645:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750650:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750656:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750662:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750667:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.750672:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.751585:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9c7eb0299e00:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1789596900.751814:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9c7eb0299200:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1789596900.752347:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752354:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752369:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752377:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752384:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752391:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752397:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752403:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752409:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752415:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752421:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752436:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752503:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752510:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752517:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752525:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752542:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752549:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752556:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752563:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752569:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752576:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752582:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752600:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752606:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752612:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752618:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752624:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752632:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752638:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752645:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752652:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752660:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752666:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752673:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752923:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752935:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752944:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752954:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752961:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752969:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752976:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752982:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752992:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.752999:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753005:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753012:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753033:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753041:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753047:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753053:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753065:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753071:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753078:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753084:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753090:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753096:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753103:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753109:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753130:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753137:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753144:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753150:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.753163:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596900.765887:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c7e95b76c00:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1789596900.771938:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c7eb0283200:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1789596900.772001:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772011:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772017:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772022:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772028:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772034:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772040:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772045:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772051:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772057:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772063:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772068:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772074:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772079:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772084:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772088:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772093:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772098:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772104:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772109:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772114:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772120:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772126:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772131:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772136:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772142:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772147:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772152:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772172:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772177:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772182:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772188:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772193:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772198:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772204:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772210:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772216:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772222:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772228:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772233:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772238:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772242:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772248:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772253:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772257:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772262:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772268:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772273:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772278:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772284:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772289:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772294:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772299:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772304:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772308:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772313:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772318:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772323:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772327:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772332:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772336:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772341:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772346:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.772357:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596900.772822:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c7eb0282e00:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1789596900.773894:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c7eb0283400:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1789596900.774665:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774674:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774707:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774713:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774718:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774724:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774730:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774745:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774752:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774759:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774765:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774770:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774776:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774781:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774786:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774791:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774796:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774801:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774805:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774810:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774815:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774821:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774826:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774831:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774836:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774840:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774845:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774850:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774855:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774860:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774864:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774869:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774874:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774878:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774897:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774902:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774907:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774912:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774928:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774933:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774938:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774943:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774949:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774954:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774959:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774964:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774968:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774974:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774978:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774983:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774988:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774993:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.774997:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775002:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775007:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775012:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775017:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775022:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775027:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775032:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775036:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775041:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775045:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.775050:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596900.775741:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c7eb0282c00:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1789596900.776007:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c7eb0283c00:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1789596900.776153:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776159:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776165:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776171:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776176:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776190:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776195:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776200:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776205:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776210:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776216:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776221:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776226:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776232:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776237:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776242:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776246:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776251:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776255:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776259:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776264:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776270:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776275:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776280:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776284:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776289:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776294:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776300:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776305:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776310:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776315:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776320:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776325:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776330:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776335:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776339:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776343:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776348:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776353:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776357:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776367:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776372:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776378:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776383:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776388:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776393:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776398:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776403:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776408:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776412:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776417:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776422:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776427:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776432:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776437:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776504:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776509:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776514:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776519:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776524:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776529:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776533:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776538:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.776543:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596900.777966:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9c7e9e299200:6532] 0 exiting: rc = 1 00000100:00100000:3.0:1789596900.778849:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9c7e9e299400:6534] 2 exiting: rc = 0 00000100:00100000:0.0:1789596900.779187:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9c7e9e299a00:6533] 1 exiting: rc = 0 00000100:00100000:3.0:1789596900.779319:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779327:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779334:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779342:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779348:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779354:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779361:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779367:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779373:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779379:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779402:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779423:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779430:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779436:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779525:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779533:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779538:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779544:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779549:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779554:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779559:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779565:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779572:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779578:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779584:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779589:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779595:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779600:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779605:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779610:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779617:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779623:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779629:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779636:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779642:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779649:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779656:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779663:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779669:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779722:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779730:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779965:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779973:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779979:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779985:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.779998:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780004:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780010:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780016:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780022:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780029:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780034:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780040:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780047:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780053:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780060:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780066:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780071:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780078:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780084:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780090:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780095:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780102:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596900.780121:0:15258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789596900.793381:0:15258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596900.793396:0:15258:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789596900.793402:0:15258:0:(genops.c:885:class_export_put()) final put ffff9c7e85337000/MDS_uuid 00000020:00000080:3.0:1789596900.793407:0:15258:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85337000/MDS_uuid for MDS 00000020:01000000:3.0:1789596900.793414:0:15258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789596900.793555:0:15258:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789596900.801495:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596900.803475:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789596900.803484:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789596900.803489:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789596900.803500:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 470 00000100:00080000:0.0:1789596900.803507:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789596900.803522:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7d82063000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596900.803569:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b6a00 x1876527984840192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596900.803633:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789596900.803638:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789596900.803640:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789596900.803644:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 470 00000100:00080000:0.0:1789596900.803647:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789596900.803652:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7eb6634000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596900.803666:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b7800 x1876527984840448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596900.803752:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984840320:0@lo:400:kworker.0 00000400:00000100:0.0:1789596900.803813:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984840320 offset 0 length 224: 4 00000100:00100000:0.0:1789596900.803889:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984840576:0@lo:400:kworker.0 00000400:00000100:0.0:1789596900.803907:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984840576 offset 0 length 224: 4 00000100:00100000:1.0:1789596900.804005:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984840192:0@lo:38:kworker.0 00000400:00000100:1.0:1789596900.804028:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984840192 offset 0 length 520: 4 00000100:00100000:1.0:1789596900.804040:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984840448:0@lo:38:kworker.0 00000400:00000100:1.0:1789596900.804049:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984840448 offset 0 length 520: 4 00010000:00010000:1.0:1789596901.821365:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596902.845674:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596903.871958:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596904.895123:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789596905.130068:0:15459:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789596905.155978:0:15459:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789596905.156042:0:15459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596905.156059:0:15459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596905.156066:0:15459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596905.156087:0:15459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596905.156184:0:15459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789596905.156192:0:15459:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789596905.156221:0:15459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789596905.156236:0:15459:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d837b6a00 x1876527984840192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789596920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596905.156256:0:15459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789596905.156265:0:15459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789596905.156272:0:15459:0:(import.c:65:import_set_state_nolock()) ffff9c7d82063000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789596905.156278:0:15459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789596905.156281:0:15459:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d837b6a00 x1876527984840192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789596920 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596905.156288:0:15459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789596905.156291:0:15459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789596905.156438:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984840192:0@lo:38:kworker.0 00000100:00080000:1.0:1789596905.158073:0:15459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789596905.158091:0:15459:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d837b4700 x1876527984840320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596905.158162:0:15459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789596905.158169:0:15459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789596905.158195:0:15459:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789596905.158328:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984840704:0@lo:39:umount.0 00000400:00000100:2.0:1789596905.158389:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984840704 offset 0 length 224: 4 00010000:00010000:3.0:1789596905.158583:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596905.158594:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596905.158606:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596905.158610:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596905.158656:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596905.158665:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596905.158672:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596905.158675:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789596905.158698:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789596905.158719:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:3.0:1789596905.158896:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596905.158904:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbe95f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe966 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596905.158921:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596905.158922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596905.158924:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596905.159206:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984840320:0@lo:400:kworker.0 00000100:00080000:0.0:1789596905.917033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789596905.917043:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789596905.917046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789596905.917050:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789596905.917183:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984840832:0@lo:400:kworker.0 00000400:00000100:1.0:1789596905.917240:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984840832 offset 0 length 224: 4 00010000:00010000:0.0:1789596905.917522:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789596905.920619:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789596905.920639:0:8430:0:(genops.c:885:class_export_put()) final put ffff9c7d82060800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789596905.923602:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d82060800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789596905.923667:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d82065000 for lustre-OST0000 00000001:00100000:0.0:1789596905.925165:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789596905.925174:0:9514:0:(genops.c:885:class_export_put()) final put ffff9c7d8365e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789596905.925260:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8365e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789596905.925315:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d8365d000 for lustre-OST0001 00010000:00010000:1.0:1789596906.941287:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596907.966104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596908.989714:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596910.013039:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596910.269869:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596900/real 1789596900] req@ffff9c7d83e78700 x1876527984840064/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789596910 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596910.269919:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d83e78700 x1876527984840064/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789596910 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789596910.269946:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596910.269982:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789596910.269986:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d576172c-8178-43f9-add9-c496dd76058d:3643:1876527984840064:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1789596910.270207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596910.270215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789596910.270220:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596910.270226:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 475 00000100:00080000:1.0:1789596910.270233:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789596910.270249:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff9c7e85337800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596910.270299:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4a80 x1876527984840960/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596910.270330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596910.270334:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789596910.270384:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d576172c-8178-43f9-add9-c496dd76058d:3643:1876527984840960:0@lo:250:kworker.0 00000400:00000100:2.0:1789596910.270452:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527984840960 offset 0 length 520: 4 00000100:00100000:3.0:1789596910.270524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596910.270538:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984841088:0@lo:400:kworker.0 00000400:00000100:3.0:1789596910.270570:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984841088 offset 0 length 224: 4 00010000:00010000:3.0:1789596911.036906:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596912.063307:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596913.089317:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596914.109116:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596915.133238:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596915.389960:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596905/real 1789596905] req@ffff9c7d831b6300 x1876527984840704/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596915 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596915.390009:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d831b6300 x1876527984840704/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596915 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789596915.390039:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789596915.390071:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984840704:0@lo:39:umount.0 00000100:00080000:1.0:1789596915.390210:0:15459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789596915.390217:0:15459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789596915.390224:0:15459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789596915.391328:0:15459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391349:0:15459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391357:0:15459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391366:0:15459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391425:0:15459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789596915.391435:0:15459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391443:0:15459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391449:0:15459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391456:0:15459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.391478:0:15459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789596915.391483:0:15459:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789596915.391516:0:15459:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789596915.391521:0:15459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789596915.391527:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596915.391535:0:15459:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789596915.391540:0:15459:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9c7d820ccd40) has no exports 00000020:00080000:1.0:1789596915.391570:0:15459:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9c7d820ccd40) has no exports 00010000:00010000:3.0:1789596915.391855:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596915.391871:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.391880:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81671800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596915.391884:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.391894:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596915.391902:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596915.391909:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596915.391911:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789596915.391915:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789596915.391932:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:3.0:1789596915.391936:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.391956:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81671800/0x7b5398e289bbe96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe974 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.391973:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596915.391976:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.391981:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596915.391985:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.392001:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596915.392007:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596915.392013:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789596915.392015:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789596915.392017:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789596915.392022:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:3.0:1789596915.392026:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.392032:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da400/0x7b5398e289bbebf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbebf8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.392041:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596915.392043:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596915.392045:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596915.393515:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789596915.396025:0:15459:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d82637900 - data ffff9c7d81d42288/ffff9c7d83723000 00000020:01000000:1.0:1789596915.396186:0:15459:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d82502360 - data ffff9c7e9e677870/ffff9c7d8247ac00 00100000:10000000:0.0:1789596915.416559:0:15459:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789596915.439167:0:15459:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe6bf 00000020:00000080:1.0:1789596915.439182:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7ebae10000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789596915.439212:0:15459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebaf79000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789596915.439215:0:15459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebaf79000 2 00000020:01000004:1.0:1789596915.439218:0:15459:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7ebaf79000 from lustre-OST0000 00000020:00000080:1.0:1789596915.439245:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596915.439268:0:15459:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789596915.439272:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7ebb0f7800/lustre-OST0000_UUID 00000020:00000080:1.0:1789596915.439275:0:15459:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebb0f7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789596915.439282:0:15459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789596915.439344:0:15459:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789596915.439348:0:15459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789596915.439351:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596915.439356:0:15459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789596915.439363:0:15459:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c7d82060000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789596915.439368:0:15459:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9c7ebb18b380) has exports, disconnecting them 00000020:00080000:1.0:1789596915.439374:0:15459:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c7d82060000), last request at 1789596663 00000020:00000080:1.0:1789596915.439378:0:15459:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe6e9 00000020:00080000:1.0:1789596915.439387:0:15459:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d82060000): rc 0 00000020:00000080:1.0:1789596915.439392:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7d82060000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789596915.440287:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebae10000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789596915.440315:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d82060000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789596915.448943:0:15459:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789596915.448953:0:15459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789596915.448958:0:15459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789596915.448968:0:15459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789596915.449201:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596915.449211:0:15459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789596915.449219:0:15459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789596915.449228:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596915.449233:0:15459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789596915.449241:0:15459:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c7d82065800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789596915.449248:0:15459:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9c7ebb188000) has exports, disconnecting them 00000020:00080000:2.0:1789596915.449253:0:15459:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c7d82065800), last request at 1789596663 00000020:00000080:2.0:1789596915.449258:0:15459:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe6fe 00000020:00080000:2.0:1789596915.449276:0:15459:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d82065800): rc 0 00000020:00000080:2.0:1789596915.449281:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7d82065800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789596915.449711:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d82063000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789596915.449720:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7d82061800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789596915.449723:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d82061800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789596915.449737:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789596915.449815:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d82065800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789596915.450732:0:15459:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789596915.450737:0:15459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789596915.450740:0:15459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789596915.450745:0:15459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789596915.450778:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb6a6b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789596915.450958:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596915.450966:0:15459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789596915.450970:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7d82064800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789596915.450974:0:15459:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d82064800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789596915.450979:0:15459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789596915.451026:0:15459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebaf79000 1 00000020:00000080:3.0:1789596915.451033:0:15459:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe687 00000020:00000080:3.0:1789596915.451039:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7e85987800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789596915.451046:0:15459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789596915.451053:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85987800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789596915.451061:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596915.451066:0:15459:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789596915.451069:0:15459:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9c7eb98bcd40) has no exports 00000020:00000080:3.0:1789596915.479083:0:15459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596915.479102:0:15459:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789596915.479110:0:15459:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf7a800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789596915.479117:0:15459:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf7a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789596915.479131:0:15459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789596915.479285:0:15459:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7ebaf79800 00000020:02000400:3.0:1789596915.479506:0:15459:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1789596915.644810:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596915.644828:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596915.644833:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596915.644836:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789596915.644965:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596915.644987:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984841216:0@lo:400:kworker.0 00000400:00000100:0.0:1789596915.645042:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984841216 offset 0 length 224: 4 00010000:00010000:1.0:1789596916.161323:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789596916.161762:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596900/real 1789596900] req@ffff9c7d837b4380 x1876527984840576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596916.200565:0:3646:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9c7d837b4380 x1876527984840576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596916.200614:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6e800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789596916.200619:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789596916.226060:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789596916.231797:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596916.231811:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596916.231814:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596916.231817:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596916.231821:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596916.231825:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789596916.231830:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596916.231850:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 261 00000100:00080000:3.0:1789596916.231876:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c7eb6a6e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596916.232002:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d825f7480 x1876527984841344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596916.232068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984841344:0@lo:38:kworker.0 00000400:00000100:3.0:1789596916.232136:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984841344 offset 0 length 520: 4 00000100:00100000:1.0:1789596916.233272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984840576:0@lo:400:kworker.0 00010000:00010000:3.0:1789596917.181658:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596918.209422:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596919.230219:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596920.254699:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596920.319832:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596900/real 1789596900] req@ffff9c7d837b7800 x1876527984840448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789596920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.319875:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d837b7800 x1876527984840448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789596920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596920.319900:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596920.319940:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789596920.319944:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984840448:0@lo:38:kworker.0 00000100:00080000:2.0:1789596920.320020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789596920.320026:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d576172c-8178-43f9-add9-c496dd76058d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596920.320028:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789596920.320044:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789596920.320047:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596920.320052:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 475 00000100:00080000:2.0:1789596920.320060:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789596920.320074:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7eb6634000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596920.320123:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e78700 x1876527984841472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596920.320152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789596920.320156:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789596920.320212:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984841472:0@lo:38:kworker.0 00000400:00000100:0.0:1789596920.320301:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984841472 offset 0 length 520: 4 00000020:01000004:3.0:1789596920.359916:0:15661:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789596920.373210:0:15661:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789596920.373459:0:15661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.373480:0:15661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.373488:0:15661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.373497:0:15661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.373674:0:15661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789596920.373704:0:15661:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789596920.373748:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596920.373765:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d83e78700 x1876527984841472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789596945 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.373790:0:15661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789596920.373798:0:15661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789596920.373806:0:15661:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6634000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789596920.373811:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596920.373815:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d83e78700 x1876527984841472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789596945 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.373821:0:15661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789596920.373825:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 33s for inflight to error out 00000100:00100000:1.0:1789596920.373920:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984841472:0@lo:38:kworker.0 00000100:00080000:0.0:1789596920.374885:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789596920.374895:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d837b4700 x1876527984840832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.374914:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d831b7480 x1876527984841088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596926 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.374932:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d831b7b80 x1876527984841216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596931 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.374946:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d825f7480 x1876527984841344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789596926 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.374953:0:15661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789596920.374979:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984841216:0@lo:400:kworker.0 00000100:00080000:0.0:1789596920.375000:0:15661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789596920.375016:0:15661:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6a6e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789596920.375020:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789596920.375024:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d837b4700 x1876527984840832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596921 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.375033:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d831b7480 x1876527984841088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596926 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.375039:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d825f7480 x1876527984841344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789596926 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596920.375046:0:15661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789596920.375048:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1789596920.375073:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984841088:0@lo:400:kworker.0 00000100:00100000:1.0:1789596920.375294:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984840832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596920.375319:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984841344:0@lo:38:kworker.0 00010000:00010000:2.0:1789596920.382194:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596920.382217:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.382232:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c6a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596920.382237:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.382249:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596920.382256:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596920.382273:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596920.382276:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789596920.382280:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789596920.382304:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:2.0:1789596920.382309:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.382342:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6a00/0x7b5398e289bbe943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe94a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.382918:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596920.382921:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596920.382924:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596920.383058:0:15661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383084:0:15661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383091:0:15661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383097:0:15661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383155:0:15661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789596920.383163:0:15661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383172:0:15661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383178:0:15661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.383184:0:15661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.383501:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596920.383573:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.383648:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596920.383652:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.383662:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596920.383668:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596920.383672:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596920.383675:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789596920.383803:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:2.0:1789596920.383806:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.383812:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbe951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe958 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.383883:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596920.383889:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.383895:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb64c7600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596920.383898:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.383905:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596920.383911:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596920.383916:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789596920.383918:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789596920.383922:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:3.0:1789596920.383932:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.383941:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596920.383942:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596920.383945:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596920.384020:0:15661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789596920.384026:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c7600/0x7b5398e289bbebe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbebea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596920.384042:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789596920.384047:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789596920.384049:0:15661:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789596920.384091:0:15661:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789596920.384095:0:15661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:3.0:1789596920.384135:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789596920.384146:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596920.384153:0:15661:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789596920.384158:0:15661:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9c7ebf9919c0) has no exports 00000020:00080000:3.0:1789596920.384184:0:15661:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9c7ebf9919c0) has no exports 00000020:01000000:3.0:1789596920.388964:0:15661:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d82637240 - data ffff9c7d81d421b0/ffff9c7d83721c00 00000020:01000000:3.0:1789596920.389186:0:15661:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d82637300 - data ffff9c7d81c0b438/ffff9c7ebb023c00 00100000:10000000:3.0:1789596920.403563:0:15661:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789596920.413710:0:15661:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe7e5 00000020:00000080:2.0:1789596920.413725:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7eb66aa800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789596920.413755:0:15661:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebb0f4000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789596920.413759:0:15661:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebb0f4000 2 00000020:01000004:2.0:1789596920.413762:0:15661:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7ebb0f4000 from lustre-OST0001 00000020:00000080:2.0:1789596920.413788:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596920.413799:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789596920.413802:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7eb66af800/lustre-OST0001_UUID 00000020:00000080:2.0:1789596920.413805:0:15661:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb66af800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789596920.413816:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789596920.413937:0:15661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d576172c-8178-43f9-add9-c496dd76058d->MGS 00010000:00010000:2.0:1789596920.413954:0:15661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030a00/0x7b5398e289bbe53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596920.413966:0:15661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030a00/0x7b5398e289bbe53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596920.413973:0:15661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789596920.413976:0:15661:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789596920.413979:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789596920.413994:0:15661:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:2.0:1789596920.413998:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030a00/0x7b5398e289bbe53e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe545 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.414012:0:15661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596920.414019:0:15661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596920.414041:0:15661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596920.414043:0:15661:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789596920.414044:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789596920.414054:0:15661:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7e85337800 00010000:00010000:2.0:1789596920.414057:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb64c6c00/0x7b5398e289bbe9b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbe9ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789596920.414072:0:15661:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789596920.414075:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789596920.414078:0:15661:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789596920.414079:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789596920.414083:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789596920.414094:0:15661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7d831b4a80 x1876527984840960/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789596925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789596920.414115:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789596920.414117:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1789596920.414330:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d576172c-8178-43f9-add9-c496dd76058d:3643:1876527984840960:0@lo:250:kworker.0 00000020:00000080:0.0:1789596920.414527:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb66aa800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1789596920.414673:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789596920.414744:0:15661:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe43b 00000020:00000080:2.0:1789596920.414751:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7e85330000/d576172c-8178-43f9-add9-c496dd76058d 00000020:01000000:2.0:1789596920.414762:0:15661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.116@tcp (flags='') 00000020:00000080:2.0:1789596920.414768:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596920.414773:0:15661:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789596920.414776:0:15661:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c7e88948000) has no exports 00000020:00000080:0.0:1789596920.414862:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85330000/d576172c-8178-43f9-add9-c496dd76058d for MGC192.168.202.116@tcp 10000000:01000000:1.0:1789596920.415074:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789596920.415368:0:15661:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.116@tcp: client import never connected 00000100:00080000:2.0:1789596920.415371:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789596920.415374:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789596920.415377:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789596920.415380:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789596920.415429:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596920.415435:0:15661:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.116@tcp (uuid d576172c-8178-43f9-add9-c496dd76058d) 00000020:01000000:2.0:1789596920.415443:0:15661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789596920.415455:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596920.415459:0:15661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789596920.415464:0:15661:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c7eb6631000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789596920.415470:0:15661:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9c7ebb1899c0) has exports, disconnecting them 00000020:00080000:2.0:1789596920.415475:0:15661:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c7eb6631000), last request at 1789596686 00000020:00000080:2.0:1789596920.415479:0:15661:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe80f 00000020:00080000:2.0:1789596920.415492:0:15661:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7eb6631000): rc 0 00000020:00000080:2.0:1789596920.415496:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7eb6631000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789596920.416300:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e85337800 for MGC192.168.202.116@tcp 00000020:00000080:0.0:1789596920.416313:0:37:0:(genops.c:885:class_export_put()) final put ffff9c7e9192c000/d576172c-8178-43f9-add9-c496dd76058d 00000020:00000080:0.0:1789596920.416316:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9192c000/d576172c-8178-43f9-add9-c496dd76058d for MGC192.168.202.116@tcp 00000020:01000000:0.0:1789596920.416322:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.116@tcp (d576172c-8178-43f9-add9-c496dd76058d) 00000020:00000080:0.0:1789596920.416640:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6631000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789596920.416817:0:15661:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789596920.416821:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596920.416826:0:15661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789596920.416833:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789596920.417033:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596920.417043:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789596920.417050:0:15661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789596920.417056:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596920.417061:0:15661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789596920.417070:0:15661:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c7d83189000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596920.417088:0:15661:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9c7d835119c0) has exports, disconnecting them 00000020:00080000:0.0:1789596920.417093:0:15661:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c7d83189000), last request at 1789596686 00000020:00000080:0.0:1789596920.417099:0:15661:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe824 00000020:00080000:0.0:1789596920.417115:0:15661:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d83189000): rc 0 00000020:00000080:0.0:1789596920.417121:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7d83189000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789596920.417879:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb6634000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789596920.417888:0:37:0:(genops.c:885:class_export_put()) final put ffff9c7eb6637000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789596920.417891:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6637000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789596920.417897:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789596920.417953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83189000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789596920.418767:0:15661:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789596920.418774:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789596920.418780:0:15661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789596920.418786:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789596920.418820:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb6a6e800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789596920.431428:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789596920.431714:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789596920.432210:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789596920.432794:0:6502:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c7e912e8000:6502] 0 exiting: rc = 1 00000100:00100000:2.0:1789596920.432995:0:6503:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c7e912e9e00:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1789596920.433099:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.433397:0:6504:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c7e912e9000:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1789596920.433569:0:6505:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c7e912e8e00:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1789596920.433651:0:7927:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c7eb6527c00:7927] 3 exiting: rc = 0 00000100:00100000:3.0:1789596920.436667:0:6506:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c7eb4636e00:6506] 2 exiting: rc = 0 00000100:00100000:1.0:1789596920.437253:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437370:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437378:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437387:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437394:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437401:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437408:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437415:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437422:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437429:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437445:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437454:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437461:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437468:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437475:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437499:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437577:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437652:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437661:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437667:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437674:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437865:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437872:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437878:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437883:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437889:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437894:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437899:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437905:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437911:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437917:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437922:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437927:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437932:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437938:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437944:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437951:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437957:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437964:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437971:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437976:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437981:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437987:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437992:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.437998:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438003:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438009:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438015:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438021:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438027:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438043:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438048:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438053:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438058:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438063:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438069:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438074:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438080:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438086:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438092:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438098:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438105:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438109:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596920.438115:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789596920.440791:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596920.440809:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789596920.440816:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7eb6633000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789596920.440823:0:15661:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6633000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789596920.440831:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789596920.440914:0:15661:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebb0f4000 1 00000020:00000080:1.0:1789596920.440924:0:15661:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbe7b4 00000020:00000080:1.0:1789596920.440934:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7ebae16800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789596920.441236:0:15661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789596920.441243:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596920.441250:0:15661:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789596920.441255:0:15661:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9c7d820c8000) has no exports 00000020:00000080:2.0:1789596920.443085:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebae16800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789596920.469274:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596920.469294:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789596920.469303:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7ebb0f2000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789596920.469311:0:15661:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebb0f2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789596920.469328:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789596920.471598:0:15661:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7ebb0f7000 00000020:01000000:0.0:1789596920.471663:0:15661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789596920.471671:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596920.471698:0:15661:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789596920.471704:0:15661:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c7ebb18cd40) has no exports 00000020:00000080:0.0:1789596920.471771:0:15661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596920.471786:0:15661:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789596920.471792:0:15661:0:(genops.c:885:class_export_put()) final put ffff9c7e85982000/OSS_uuid 00000020:00000080:0.0:1789596920.471797:0:15661:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85982000/OSS_uuid for OSS 00000020:01000000:0.0:1789596920.471804:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789596920.471939:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9c7eb6510e00:8436] 1 exiting: rc = 0 00000100:00080000:1.0:1789596920.472240:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789596920.472367:0:9893:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9c7d83183600:9893] 3 exiting: rc = 0 00000100:00100000:2.0:1789596920.472748:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9c7eb45b7400:8435] 0 exiting: rc = 1 00000100:00100000:2.0:1789596920.472837:0:14227:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9c7e92a9ce00:14227] 4 exiting: rc = 0 00000100:00100000:2.0:1789596920.472915:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9c7eb6526c00:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1789596920.473143:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473153:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473160:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473167:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473173:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473178:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473184:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473190:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473195:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473328:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473336:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473342:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473348:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473353:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473359:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473365:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473371:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473375:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473381:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473386:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473392:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473397:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473402:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473408:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473414:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473420:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473425:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473430:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473435:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473441:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473446:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473451:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473456:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473462:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473468:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473475:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473504:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473511:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473651:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473658:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473663:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473669:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473758:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473768:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473784:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473789:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473795:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473801:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473807:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473813:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473818:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473824:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473831:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473836:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473845:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473850:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473855:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473860:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473866:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473873:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473878:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473885:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473891:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.473903:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475483:0:10297:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c7d83182a00:10297] 2 exiting: rc = 0 00000100:00100000:3.0:1789596920.475783:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c7ebaff7e00:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1789596920.475858:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c7ebaff6a00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1789596920.475950:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475964:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475971:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475976:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475982:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475987:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475993:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.475999:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476006:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476011:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476016:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476021:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476028:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476032:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476056:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476060:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476066:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476071:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476077:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476082:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476087:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476093:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476098:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476104:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476109:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476114:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476119:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476125:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476132:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476137:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476142:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476147:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476153:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476159:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476164:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476170:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476175:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476180:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476186:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476191:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476196:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476201:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476208:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476214:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476221:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476231:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476238:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476244:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476249:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476272:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476279:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476285:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476290:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476297:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476302:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476308:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476314:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476319:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476324:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476330:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476336:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476341:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476346:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.476356:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596920.477968:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c7e9d7b6000:8442] 2 exiting: rc = 0 00000100:00100000:0.0:1789596920.478386:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c7e92d7f600:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1789596920.478936:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c7eb6524a00:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1789596920.479077:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479086:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479093:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479099:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479105:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479111:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479118:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479124:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479130:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479137:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479143:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479150:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479158:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479167:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479174:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479181:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479188:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479194:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479234:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479254:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479271:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479278:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479284:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479290:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479297:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479303:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479309:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479315:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479322:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479328:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479335:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479341:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479348:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479354:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479362:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479370:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479376:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479382:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479388:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479394:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479400:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479405:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479412:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479432:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479439:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479445:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479452:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479458:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479465:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479470:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479477:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479484:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479500:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479823:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479830:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479837:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479845:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479852:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479859:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479865:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479874:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479882:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479889:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596920.479903:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.486805:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c7eb5548c00:8443] 0 exiting: rc = 1 00000100:00100000:1.0:1789596920.487145:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c7ea67f2800:8444] 1 exiting: rc = 0 00000100:00100000:3.0:1789596920.487302:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487312:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487367:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487373:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487379:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487384:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487390:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487396:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487403:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487409:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487414:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487420:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487427:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487433:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487467:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487477:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487483:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487490:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487496:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487502:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487509:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487515:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487522:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487527:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487534:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487540:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487545:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487551:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487559:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487565:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487572:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487580:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487586:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487606:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487612:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487620:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487626:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487632:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487638:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487643:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487648:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487654:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487662:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487668:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487674:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487714:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487719:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487725:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487731:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487755:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487762:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487768:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487782:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487790:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487797:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487804:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487809:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487814:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487819:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487825:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487831:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487836:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487842:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.487851:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.488794:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c7eb6523e00:8446] 1 exiting: rc = 0 00000100:00100000:1.0:1789596920.489227:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c7eb6522000:8445] 0 exiting: rc = 1 00000100:00100000:3.0:1789596920.489880:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489890:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489897:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489903:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489909:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489916:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489923:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489930:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489939:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489946:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489953:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489960:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489984:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489993:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.489999:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490006:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490014:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490020:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490028:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490056:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490067:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490074:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490081:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490088:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490107:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490114:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490122:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490129:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490137:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490144:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490152:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490158:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490165:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490171:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490177:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490183:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490203:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490211:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490229:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490236:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490244:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490251:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490266:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490275:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490283:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490290:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490296:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490303:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490325:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490336:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490342:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490351:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490357:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490364:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490380:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490386:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490393:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490399:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490406:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490413:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490432:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490439:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490446:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596920.490454:0:15661:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789596920.505730:0:15661:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789596947.408258:0:16426:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789596960.977883:0:17025:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789596960.977900:0:17025:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789596960.977901:0:17025:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789596960.978037:0:17025:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7ebfae6000 00000020:01000004:0.0:1789596960.978055:0:17025:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789596960.978064:0:17025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789596960.978079:0:17025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c7e9e3599c0) 00000020:00000080:0.0:1789596960.978094:0:17025:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789596961.039255:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789596961.040741:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.042418:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.044946:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.045226:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.045528:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.045941:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.046271:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.046588:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.046964:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.047273:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.047585:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.047955:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.048253:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.048538:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.048901:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.049220:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.049516:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.049827:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.050221:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.050475:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.050791:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.051149:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.051460:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.051760:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.052185:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.052486:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.052759:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.053130:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.053344:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.053709:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.054028:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.054305:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.054589:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789596961.054950:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789596961.056742:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789596961.057396:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.057817:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789596961.058343:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789596961.058662:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.058974:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.059244:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.059531:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789596961.059841:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.060227:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789596961.060531:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.060883:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789596961.062751:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.063327:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.063595:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.064176:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.064453:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789596961.064674:0:17025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1789596961.065544:0:17025:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789596961.065848:0:17025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789596961.065857:0:17025:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789596961.065869:0:17025:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbf9ea 00000020:01000004:1.0:1789596961.065876:0:17025:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789596961.065882:0:17025:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789596961.065887:0:17025:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7ebfae6000 from MGS 00000020:01000004:1.0:1789596961.065890:0:17025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789596961.065899:0:17025:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c7ebf994d40) 00000020:00000080:1.0:1789596961.065908:0:17025:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789596961.065967:0:17025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebfae6000 from MGS, refs=2 00080000:01000000:1.0:1789596961.065971:0:17025:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789596961.065976:0:17025:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbf9f8 00000100:00100000:1.0:1789596961.066067:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789596961.066194:0:17025:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789596961.066202:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789596961.067248:0:17025:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789596961.067257:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789596961.068356:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596961.068553:0:17025:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789596961.068559:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789596961.069504:0:17025:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789596961.069513:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789596961.070409:0:17025:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789596961.070421:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789596961.071508:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.071512:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.071514:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.072470:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.072473:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.072475:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596961.073497:0:17025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789596961.081146:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789596961.081192:0:17025:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789596961.084781:0:17037:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789596961.084902:0:17025:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789596961.084974:0:17025:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789596961.086107:0:17025:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789596961.086520:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596961.087276:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789596961.087633:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789596961.097248:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789596961.097267:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789596961.100710:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789596961.100724:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789596961.101738:0:17025:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789596961.101762:0:17025:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000100:00080000:0.0:1789596961.102121:0:17042:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1789596961.102149:0:17025:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789596961.102184:0:17025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:3.0:1789596961.102197:0:17025:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (ffff9c7d83514d40) 00000020:00000080:3.0:1789596961.102213:0:17025:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789596961.102359:0:17025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7ebfa98800@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596961.102517:0:17025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:3.0:1789596961.102525:0:17025:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789596961.107008:0:17043:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789596961.107434:0:17025:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid f66223a4-de53-4574-9339-460f93dd2c76) 00000020:00000080:3.0:1789596961.107463:0:17025:0:(genops.c:1384:class_connect()) connect: client f66223a4-de53-4574-9339-460f93dd2c76, cookie 0x7b5398e289bbfa06 00000100:00080000:3.0:1789596961.107477:0:17025:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596961.107498:0:17025:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff9c7ebfa98800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596961.107534:0:17025:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d825f7800 x1876527984841600/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596961.107660:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f66223a4-de53-4574-9339-460f93dd2c76:3643:1876527984841600:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789596961.107746:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596961.107950:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984841600 00000100:00100000:0.0:1789596961.107957:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984841600 00000100:00100000:0.0:1789596961.107996:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596961.108004:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876527984841600:12345-0@lo:250:mount.lustre.0 00000100:00080000:3.0:1789596961.109752:0:17025:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f66223a4-de53-4574-9339-460f93dd2c76->MGS 00000020:01000004:3.0:1789596961.109787:0:17025:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789596961.109796:0:17025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789596961.109815:0:17025:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c7d83513380) 00000020:00000080:3.0:1789596961.109833:0:17025:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00080000:0.0:1789596961.111117:0:17039:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f66223a4-de53-4574-9339-460f93dd2c76@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1789596961.111150:0:17039:0:(genops.c:1384:class_connect()) connect: client f66223a4-de53-4574-9339-460f93dd2c76, cookie 0x7b5398e289bbfa14 00000100:00080000:0.0:1789596961.111297:0:17039:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596961.118233:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+5:3643:x1876527984841600:12345-0@lo:250:mount.lustre.0 Request processed in 10212us (10470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596961.118253:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596961.126788:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789596961.126806:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:1.0:1789596961.126815:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789596961.126821:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789596961.126826:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa98800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789596961.126830:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789596961.129728:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789596961.129752:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f66223a4-de53-4574-9339-460f93dd2c76:3643:1876527984841600:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789596961.132307:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596961.132552:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789596961.132558:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789596961.134834:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789596961.134847:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789596961.140448:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596961.140465:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789596961.145556:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596961.145809:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789596961.145816:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789596961.147475:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789596961.147487:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789596961.231629:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596961.232264:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789596961.232271:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789596961.233955:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789596961.234037:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789596961.235013:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596961.235394:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789596961.235400:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789596961.236424:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596961.236432:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789596961.237377:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596961.237572:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789596961.237578:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789596961.240858:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596961.240877:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789596961.241963:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596961.242380:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789596961.242388:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789596961.243357:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596961.243375:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789596961.265582:0:17025:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596961.266010:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789596961.266029:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789596961.268443:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789596961.268460:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789596961.269646:0:17025:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789596961.269657:0:17025:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789596961.273340:0:17025:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789596961.273382:0:17025:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789596961.273389:0:17025:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789596961.273537:0:17025:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789596961.273585:0:17025:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789596961.273590:0:17025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789596961.273591:0:17025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596961.273593:0:17025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596961.273594:0:17025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596961.273595:0:17025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596961.273597:0:17025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596961.273598:0:17025:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596961.273599:0:17025:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596961.273601:0:17025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596961.273602:0:17025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789596961.273604:0:17025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789596961.273609:0:17025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596961.273610:0:17025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596961.273611:0:17025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596961.273612:0:17025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596961.273613:0:17025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596961.273614:0:17025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596961.273615:0:17025:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596961.273616:0:17025:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596961.273617:0:17025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596961.273618:0:17025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789596961.273644:0:17025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789596961.273663:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984841728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596961.273883:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.274043:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596961.274253:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984841728 00000100:00100000:1.0:1789596961.274262:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984841728 00000100:00100000:1.0:1789596961.274343:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596961.274352:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+5:17025:x1876527984841728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789596961.274413:0:17041:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789596961.274416:0:17041:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789596961.274419:0:17041:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789596961.274765:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789596961.275344:0:17041:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789596961.277472:0:17064:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789596961.277482:0:17064:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789596961.277485:0:17064:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789596961.277488:0:17064:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789596961.277665:0:17064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789596961.278246:0:17041:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789596961.278262:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789596961.281161:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+5:17025:x1876527984841728:12345-0@lo:253:mount.lustre.0 Request processed in 6800us (7268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596961.281177:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596961.281368:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984841728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789596961.281386:0:17025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789596961.281389:0:17025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596961.281391:0:17025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596961.281392:0:17025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596961.281393:0:17025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596961.281394:0:17025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596961.281395:0:17025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596961.281396:0:17025:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596961.281397:0:17025:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596961.281399:0:17025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596961.281400:0:17025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789596961.281430:0:17025:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7ebfae6000 from lustre-MDT0000 10000000:01000000:3.0:1789596961.281460:0:17025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789596961.281463:0:17025:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789596961.281467:0:17025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c7d83514d40 10000000:01000000:3.0:1789596961.281482:0:17025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596961.281491:0:17025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7d83514d40 from 1 10000000:01000000:3.0:1789596961.281494:0:17025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789596961.281537:0:17025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.281548:0:17025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.281557:0:17025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.281577:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984841856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596961.281617:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.281738:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596961.281951:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984841856 00000100:00100000:0.0:1789596961.281959:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984841856 00000100:00100000:0.0:1789596961.282239:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596961.282250:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+5:17025:x1876527984841856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596961.282267:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596961.282285:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbfa22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfa1b expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596961.282311:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbfa22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfa1b expref: 6 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596961.282325:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbfa22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfa1b expref: 6 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596961.282348:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743400, rc 0) 00000100:00100000:0.0:1789596961.282404:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+6:17025:x1876527984841856:12345-0@lo:101:mount.lustre.0 Request processed in 157us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596961.282410:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596961.282479:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984841856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.282493:0:17025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.282502:0:17025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.282561:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984841984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.282586:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.282732:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.282846:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984841984 00000100:00100000:2.0:1789596961.282851:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984841984 00000100:00100000:2.0:1789596961.282874:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596961.282880:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+6:17025:x1876527984841984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596961.282979:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+6:17025:x1876527984841984:12345-0@lo:501:mount.lustre.0 Request processed in 99us (392us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596961.282987:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596961.283059:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984841984:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789596961.283086:0:17025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789596961.283116:0:17025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283144:0:17025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596961.283152:0:17025:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7ebfae6000 10000000:01000000:3.0:1789596961.283157:0:17025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789596961.283160:0:17025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7ebfae6000 10000000:01000000:3.0:1789596961.283162:0:17025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789596961.283165:0:17025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7ebfae6000 from 1 10000000:01000000:3.0:1789596961.283167:0:17025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789596961.283185:0:17025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283193:0:17025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283201:0:17025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.283214:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596961.283239:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.283256:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.283378:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984842112 00000100:00100000:2.0:1789596961.283383:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984842112 00000100:00100000:2.0:1789596961.283400:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596961.283406:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+6:17025:x1876527984842112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596961.283413:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596961.283426:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bbfa30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfa29 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.283440:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bbfa30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfa29 expref: 7 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.283448:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bbfa30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfa29 expref: 7 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.283467:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd800, rc 0) 00000100:00100000:2.0:1789596961.283505:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+7:17025:x1876527984842112:12345-0@lo:101:mount.lustre.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.283511:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596961.283645:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.283657:0:17025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283664:0:17025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596961.283714:0:17025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789596961.283728:0:17025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283735:0:17025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596961.283741:0:17025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789596961.283745:0:17025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596961.283749:0:17025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7ebfae6000 10000000:01000000:3.0:1789596961.283751:0:17025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789596961.283755:0:17025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789596961.283756:0:17025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789596961.283770:0:17025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283777:0:17025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.283784:0:17025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.283796:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596961.283821:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.283832:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.283888:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984842240 00000100:00100000:2.0:1789596961.283892:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984842240 00000100:00100000:2.0:1789596961.283910:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596961.283915:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+7:17025:x1876527984842240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596961.283922:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596961.283929:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dcc00/0x7b5398e289bbfa3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfa37 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.283940:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dcc00/0x7b5398e289bbfa3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfa37 expref: 8 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.283947:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dcc00/0x7b5398e289bbfa3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfa37 expref: 8 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.283953:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dcc00, rc 0) 00000100:00100000:2.0:1789596961.283985:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+8:17025:x1876527984842240:12345-0@lo:101:mount.lustre.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.283991:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596961.284221:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.284231:0:17025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.284246:0:17025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.284290:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.284313:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.284341:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.284390:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984842368 00000100:00100000:2.0:1789596961.284394:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984842368 00000100:00100000:2.0:1789596961.284411:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596961.284415:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+8:17025:x1876527984842368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596961.284545:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+9:17025:x1876527984842368:12345-0@lo:501:mount.lustre.0 Request processed in 129us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.284557:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596961.284626:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.284651:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596961.284726:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.284736:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.284787:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984842496 00000100:00100000:2.0:1789596961.284791:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984842496 00000100:00100000:2.0:1789596961.284810:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596961.284815:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+9:17025:x1876527984842496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596961.285942:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+9:17025:x1876527984842496:12345-0@lo:503:mount.lustre.0 Request processed in 1119us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.285954:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596961.286055:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984842496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596961.286630:0:17065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17065:1876527984842624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.286676:0:17065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.286743:0:17065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596961.286865:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984842624 00000100:00100000:0.0:1789596961.286873:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984842624 00000100:00100000:0.0:1789596961.286967:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596961.286977:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+9:17065:x1876527984842624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596961.287930:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+9:17065:x1876527984842624:12345-0@lo:502:llog_process_th.0 Request processed in 948us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596961.287939:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596961.288114:0:17065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17065:1876527984842624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596961.288152:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596961.288163:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596961.288166:0:17065:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789596961.288173:0:17065:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789596961.288176:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596961.288192:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c7d83510000) 00000020:00000080:3.0:1789596961.288209:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789596961.288215:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789596961.288314:0:17065:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789596961.288323:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbfa4c 00000020:00000080:3.0:1789596961.288566:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789596961.288572:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596961.288576:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596961.288577:0:17065:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789596961.288580:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596961.288584:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596961.288585:0:17065:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789596961.288589:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596961.288598:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c7d835119c0) 00000020:00000080:3.0:1789596961.288609:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789596961.288612:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789596961.288615:0:17065:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789596961.288618:0:17065:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789596961.288623:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789596961.288664:0:17065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebfae6000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789596961.288708:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c7ebb18cd40) 00000020:00000080:3.0:1789596961.288718:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789596961.288777:0:17065:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789596961.288782:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfa61 00000020:00000080:3.0:1789596961.288902:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789596961.288909:0:17065:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789596961.288913:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7b5398e289bbfa68 00080000:01000000:3.0:1789596961.288918:0:17065:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789596961.288921:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbfa6f 00010000:00010000:2.0:1789596961.397508:0:17065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789596961.399337:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789596961.399971:0:17065:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789596961.401909:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c7d820c8000) 00000020:00000080:2.0:1789596961.401932:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789596961.406792:0:17065:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789596961.406812:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbfa7d 00000020:00000080:0.0:1789596961.416755:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789596961.429197:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7b5398e289bbfa84 00000020:00000080:0.0:1789596961.429563:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789596961.429576:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596961.429582:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596961.429585:0:17065:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789596961.429588:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789596961.429591:0:17065:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1789596961.429592:0:17065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789596961.429594:0:17065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789596961.429595:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789596961.429598:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596961.429599:0:17065:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789596961.429602:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596961.429607:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596961.429608:0:17065:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789596961.429613:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789596961.429652:0:17065:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789596961.429675:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596961.429708:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596961.429710:0:17065:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789596961.429713:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596961.429716:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596961.429717:0:17065:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789596961.429720:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789596961.429725:0:17065:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:0.0:1789596961.429753:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789596961.429769:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c7e9e35cd40) 00000020:00000080:0.0:1789596961.429784:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789596961.429789:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789596961.429846:0:17065:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789596961.429853:0:17065:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789596961.429858:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbfa92 00010000:00080000:0.0:1789596961.430082:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7ebaf7d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789596961.437234:0:17065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789596961.441518:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596961.441534:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789596961.441579:0:17065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789596961.441604:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfa99 00000100:00080000:1.0:1789596961.441617:0:17065:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596961.441630:0:17065:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7ebaf7d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596961.441673:0:17065:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4a80 x1876527984842752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596961.441745:0:17065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789596961.441804:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596961.441808:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.441809:0:17065:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789596961.441813:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789596961.441815:0:17065:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789596961.441817:0:17065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596961.441819:0:17065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596961.441836:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789596961.441839:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.441840:0:17065:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789596961.441843:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789596961.441848:0:17065:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789596961.441852:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.441853:0:17065:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789596961.441856:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789596961.441860:0:17065:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789596961.441884:0:17065:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789596961.441886:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596961.441900:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c7ebf993380) 00000020:00000080:1.0:1789596961.441912:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789596961.441917:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789596961.441980:0:17065:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789596961.441986:0:17065:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789596961.441992:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbfaa7 00010000:00080000:1.0:1789596961.442043:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7ebaf79800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789596961.442344:0:17065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789596961.443327:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984842752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596961.443430:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.443579:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984842752 00000100:00100000:3.0:1789596961.443588:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984842752 00000100:00100000:3.0:1789596961.443616:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596961.443624:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984842752:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789596961.443641:0:17052:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1789596961.445839:0:17065:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789596961.446173:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789596961.452261:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596961.454967:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789596961.478076:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789596961.479222:0:17071:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789596961.479229:0:17071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789596961.511867:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984842752:12345-0@lo:38:llog_process_th.0 Request processed in 68236us (68430us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789596961.511893:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789596961.513480:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596961.513496:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789596961.513502:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984842752:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1789596961.524718:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789596961.524741:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789596961.527716:0:17065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789596961.527759:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfaae 00000100:00080000:2.0:1789596961.527774:0:17065:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596961.527791:0:17065:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7ebaf79800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596961.527841:0:17065:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e7bb80 x1876527984842880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596961.527869:0:17065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789596961.527971:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596961.527979:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.527981:0:17065:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789596961.527984:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789596961.527988:0:17065:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789596961.527997:0:17065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789596961.528000:0:17065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789596961.528001:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789596961.528004:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.528005:0:17065:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789596961.528008:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596961.528013:0:17065:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789596961.528018:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.528019:0:17065:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789596961.528023:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789596961.528028:0:17065:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789596961.528055:0:17065:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789596961.528057:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596961.528076:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c7d820ccd40) 00000020:00000080:2.0:1789596961.528092:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789596961.528098:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789596961.528183:0:17065:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789596961.528190:0:17065:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789596961.528197:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bbfabc 00010000:00080000:2.0:1789596961.528229:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb66aa000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789596961.528499:0:17065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789596961.528585:0:17065:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789596961.528606:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1789596961.529219:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984842880:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789596961.529298:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984842880 offset 0 length 520: 4 00000040:00080000:1.0:1789596961.534183:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596961.534412:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789596961.534585:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789596961.535570:0:17073:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789596961.535577:0:17073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789596961.543972:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596961.543992:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789596961.544048:0:17065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789596961.544074:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfac3 00000100:00080000:1.0:1789596961.544088:0:17065:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596961.544103:0:17065:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596961.544165:0:17065:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4a80 x1876527984843008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596961.544189:0:17065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789596961.544258:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596961.544263:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.544265:0:17065:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789596961.544268:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596961.544273:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.544275:0:17065:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789596961.544278:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789596961.544280:0:17065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789596961.544282:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596961.544284:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.544285:0:17065:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789596961.544288:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596961.544290:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.544292:0:17065:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789596961.544296:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789596961.544329:0:17065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17065:1876527984843136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596961.544423:0:17065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596961.544463:0:17065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb02a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.544643:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843136 00000100:00100000:2.0:1789596961.544650:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843136 00000100:00100000:2.0:1789596961.544727:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596961.544737:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+9:17065:x1876527984843136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596961.544872:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+9:17065:x1876527984843136:12345-0@lo:502:llog_process_th.0 Request processed in 136us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.544880:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596961.545037:0:17065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17065:1876527984843136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596961.545068:0:17065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596961.545073:0:17065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596961.545074:0:17065:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789596961.545078:0:17065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789596961.545330:0:17025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789596961.545354:0:17025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789596961.545386:0:17025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.545400:0:17025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596961.545410:0:17025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7ebfae6000 from 1 10000000:01000000:3.0:1789596961.545413:0:17025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789596961.545447:0:17025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.545455:0:17025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.545464:0:17025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.545481:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596961.545517:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.545547:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596961.545623:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984843008:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789596961.545653:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984843008 offset 0 length 520: 4 00000100:00100000:1.0:1789596961.545852:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843264 00000100:00100000:1.0:1789596961.545857:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843264 00000100:00100000:1.0:1789596961.545900:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596961.545908:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+9:17025:x1876527984843264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596961.545933:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596961.545949:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfaca expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596961.545973:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596961.545984:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596961.545993:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1a00, rc 0) 00000100:00100000:1.0:1789596961.546026:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+10:17025:x1876527984843264:12345-0@lo:101:mount.lustre.0 Request processed in 119us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596961.546032:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596961.546217:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.546231:0:17025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.546253:0:17025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.546827:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843392:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789596961.546872:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.547019:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.550095:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843392 00000100:00100000:2.0:1789596961.550139:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843392 00000100:00100000:2.0:1789596961.550211:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596961.550219:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+10:17025:x1876527984843392:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789596961.550249:0:17039:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789596961.550254:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789596961.550411:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+10:17025:x1876527984843392:12345-0@lo:256:mount.lustre.0 Request processed in 193us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.550417:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596961.550546:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843392:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789596961.551051:0:17025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789596961.551068:0:17025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551081:0:17025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596961.551089:0:17025:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebfae6000 from 1 10000000:01000000:3.0:1789596961.551091:0:17025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596961.551127:0:17025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551135:0:17025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551143:0:17025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.551163:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596961.551199:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.551276:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9af73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.551300:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843520 00000100:00100000:3.0:1789596961.551305:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843520 00000100:00100000:3.0:1789596961.551330:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596961.551336:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+10:17025:x1876527984843520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.551346:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596961.551391:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfad8 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551414:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 11 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551424:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 11 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551434:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81511a00, rc 0) 00000100:00100000:3.0:1789596961.551464:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17025:x1876527984843520:12345-0@lo:101:mount.lustre.0 Request processed in 128us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.551470:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596961.551505:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.551518:0:17025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.551528:0:17025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.551581:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.551605:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.551623:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82b8ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.551635:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843648 00000100:00100000:3.0:1789596961.551639:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843648 00000100:00100000:3.0:1789596961.551655:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789596961.551661:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17025:x1876527984843648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.551832:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17025:x1876527984843648:12345-0@lo:501:mount.lustre.0 Request processed in 171us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.551839:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789596961.551868:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.551899:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596961.551942:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.551955:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82b8ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.551967:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843776 00000100:00100000:3.0:1789596961.551970:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843776 00000100:00100000:3.0:1789596961.551987:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789596961.551992:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17025:x1876527984843776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596961.552074:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17025:x1876527984843776:12345-0@lo:503:mount.lustre.0 Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.552080:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789596961.552117:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984843776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596961.553193:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17075:1876527984843904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596961.553261:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.553355:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984843904 00000100:00100000:3.0:1789596961.553368:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984843904 00000100:00100000:3.0:1789596961.553453:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789596961.553462:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17075:x1876527984843904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.554074:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17075:x1876527984843904:12345-0@lo:502:llog_process_th.0 Request processed in 611us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.554090:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789596961.554167:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0ef0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.554188:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17075:1876527984843904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596961.554212:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596961.554221:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.554223:0:17075:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789596961.554230:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7ebfae6000 00000020:00000080:2.0:1789596961.554233:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596961.554241:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596961.554243:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.554244:0:17075:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789596961.554246:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596961.554248:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.554250:0:17075:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789596961.554253:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7ebfae6000 00000020:00000080:2.0:1789596961.554255:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596961.554441:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596961.554446:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.554447:0:17075:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789596961.554450:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596961.554452:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.554458:0:17075:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789596961.554463:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7ebfae6000 00000020:00000080:2.0:1789596961.554466:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596961.557416:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596961.557428:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.557431:0:17075:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789596961.557435:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596961.557439:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.557441:0:17075:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789596961.557446:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7ebfae6000 00000020:00000080:2.0:1789596961.557448:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789596961.557541:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17075:1876527984844032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596961.557616:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596961.557667:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.557851:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844032 00000100:00100000:3.0:1789596961.557860:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844032 00000100:00100000:3.0:1789596961.558224:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789596961.558237:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+11:17075:x1876527984844032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.558419:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+11:17075:x1876527984844032:12345-0@lo:502:llog_process_th.0 Request processed in 184us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.558427:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596961.563066:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17075:1876527984844032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596961.563120:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596961.563130:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596961.563132:0:17075:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789596961.563138:0:17075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789596961.564319:0:17025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789596961.564367:0:17025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596961.564390:0:17025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.564403:0:17025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596961.564464:0:17025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789596961.564468:0:17025:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7ebfae6000 10000000:01000000:2.0:1789596961.564471:0:17025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7ebfae6000 10000000:01000000:2.0:1789596961.564486:0:17025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596961.564492:0:17025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7ebfae6000 from 1 10000000:01000000:2.0:1789596961.564495:0:17025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596961.564538:0:17025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.564547:0:17025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.564558:0:17025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596961.564583:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984844160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789596961.564649:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596961.564714:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.565090:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844160 00000100:00100000:3.0:1789596961.565099:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844160 00000100:00100000:3.0:1789596961.565154:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789596961.565164:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+11:17025:x1876527984844160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596961.565181:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596961.565194:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbfaed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfae6 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.565216:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbfaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfae6 expref: 12 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.565227:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbfaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfae6 expref: 12 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.565235:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510800, rc 0) 00000100:00100000:2.0:1789596961.567698:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984844160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596961.567733:0:17025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.567748:0:17025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.567877:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984844160:12345-0@lo:101:mount.lustre.0 Request processed in 116us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.568370:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789596961.570182:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984844288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596961.570260:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596961.573228:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.574268:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844288 00000100:00100000:3.0:1789596961.574438:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844288 00000100:00100000:3.0:1789596961.574506:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789596961.574516:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984844288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596961.575464:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984844288:12345-0@lo:501:mount.lustre.0 Request processed in 945us (5200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.575473:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596961.577570:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984844288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596961.577639:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984844416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596961.577745:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596961.577803:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596961.584144:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844416 00000100:00100000:0.0:1789596961.584164:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844416 00000100:00100000:0.0:1789596961.584228:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596961.584241:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984844416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596961.584449:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984844416:12345-0@lo:503:mount.lustre.0 Request processed in 211us (6703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596961.584456:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596961.584603:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984844416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596961.585840:0:17080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17080:1876527984844544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596961.585907:0:17080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596961.585952:0:17080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652180 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.586227:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844544 00000100:00100000:3.0:1789596961.586236:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844544 00000100:00100000:3.0:1789596961.586289:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789596961.586298:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17080:x1876527984844544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.586444:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17080:x1876527984844544:12345-0@lo:502:llog_process_th.0 Request processed in 148us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.586453:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789596961.586507:0:17080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17080:1876527984844544:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789596961.586565:0:17080:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789596961.586581:0:17080:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c7ebb1899c0) 00000020:00000080:3.0:1789596961.586601:0:17080:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789596961.586718:0:17080:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7ebfae6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789596961.586723:0:17080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebfae6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789596961.586726:0:17080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebfae6000 4 00010000:00080000:3.0:1789596961.586755:0:17080:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d83da9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596961.588487:0:17080:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789596961.598693:0:17080:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789596961.598762:0:17080:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789596961.598775:0:17080:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7b5398e289bbfafb 00000100:00080000:0.0:1789596961.598787:0:17080:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596961.598800:0:17080:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c7d83da9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596961.598839:0:17080:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b7100 x1876527984844672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596961.598873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984844672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596961.598940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789596961.599002:0:17080:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789596961.599136:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844672 00000100:00100000:2.0:1789596961.599145:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844672 00000100:00100000:2.0:1789596961.599175:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596961.599182:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984844672:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789596961.599239:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984844672:12345-0@lo:38:llog_process_th.0 Request processed in 57us (299us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789596961.599246:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596961.599858:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596961.599867:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596961.599871:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789596961.599875:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984844672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789596961.602144:0:17080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17080:1876527984844800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596961.602246:0:17080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596961.602312:0:17080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d03c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.605127:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844800 00000100:00100000:3.0:1789596961.605145:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844800 00000100:00100000:3.0:1789596961.605217:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789596961.605230:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+12:17080:x1876527984844800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.605464:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+12:17080:x1876527984844800:12345-0@lo:502:llog_process_th.0 Request processed in 235us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.605479:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789596961.605563:0:17080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17080:1876527984844800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.605633:0:17080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17080:1876527984844928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.605704:0:17080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.605732:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984844928 00000100:00100000:3.0:1789596961.605736:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984844928 00000100:00100000:3.0:1789596961.605759:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789596961.605765:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17080:x1876527984844928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596961.605826:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17080:x1876527984844928:12345-0@lo:502:llog_process_th.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.605833:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789596961.605874:0:17080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88b33600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.605887:0:17080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f66223a4-de53-4574-9339-460f93dd2c76:17080:1876527984844928:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789596961.605906:0:17080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789596961.606012:0:17025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789596961.606038:0:17025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596961.606056:0:17025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.606070:0:17025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596961.606124:0:17025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596961.606126:0:17025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596961.606128:0:17025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596961.606129:0:17025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596961.606134:0:17025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596961.606136:0:17025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596961.606137:0:17025:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596961.606139:0:17025:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596961.606141:0:17025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596961.606142:0:17025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596961.606146:0:17025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789596961.606149:0:17025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596961.606150:0:17025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596961.606151:0:17025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596961.606152:0:17025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596961.606153:0:17025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596961.606154:0:17025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596961.606155:0:17025:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596961.606156:0:17025:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596961.606157:0:17025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596961.606158:0:17025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596961.606171:0:17025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789596961.606179:0:17025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984845056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596961.606208:0:17025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.606222:0:17025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88b33600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596961.606245:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845056 00000100:00100000:3.0:1789596961.606249:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845056 00000100:00100000:3.0:1789596961.606270:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789596961.606275:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984845056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789596961.606295:0:17041:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789596961.606309:0:17041:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789596961.607995:0:17041:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789596961.608007:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789596961.608050:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789596961.608055:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789596961.608074:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.608092:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.608108:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.608144:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.608159:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 12 pid: 17041 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.608175:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984845184:0@lo:104: 00000100:00100000:3.0:1789596961.608235:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.608275:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88073840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596961.608852:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845184 00000100:00100000:2.0:1789596961.608860:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845184 00000100:00100000:2.0:1789596961.608909:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596961.608919:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984845184:12345-0@lo:104: 00010000:00010000:2.0:1789596961.608932:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596961.609160:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596961.609168:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984845184:12345-0@lo:104: Request processed in 250us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.609175:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596961.612340:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984845184:0@lo:104: 00010000:00010000:3.0:1789596961.612390:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612419:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596961.612427:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612436:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ec2052800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596961.612441:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612452:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596961.612461:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596961.612478:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596961.612537:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612544:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596961.612571:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612578:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052800/0x7b5398e289bbfaca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfad1 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612596:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.612598:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596961.612600:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596961.612647:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984845312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596961.612749:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596961.612844:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845312 00000100:00100000:3.0:1789596961.612852:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845312 00010000:00010000:3.0:1789596961.612878:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 13 pid: 17041 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596961.612907:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596961.612916:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+13:3646:x1876527984845312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596961.612939:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596961.612945:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 13 pid: 17041 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.612956:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 13 pid: 17041 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615434:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a1a00/0x7b5398e289bbfad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfaca expref: 13 pid: 17041 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615459:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615469:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789596961.615491:0:17031:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007435860s 00010000:00010000:3.0:1789596961.615497:0:17031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615505:0:17031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615513:0:17031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615521:0:17031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615528:0:17031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596961.615533:0:17031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.615543:0:17031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596961.615860:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17025:x1876527984845056:12345-0@lo:253:mount.lustre.0 Request processed in 9581us (9648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596961.615870:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789596961.618582:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596961.618611:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.621433:0:17031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.621466:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510a00/0x7b5398e289bbfb02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596961.621494:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596961.621602:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+11:3646:x1876527984845312:12345-0@lo:103:ldlm_bl.0 Request processed in 8683us (8849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596961.621614:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596961.621718:0:17025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17025:1876527984845056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789596961.621737:0:17025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789596961.621741:0:17025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596961.621742:0:17025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596961.621744:0:17025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596961.621745:0:17025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596961.621746:0:17025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596961.621748:0:17025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596961.621749:0:17025:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596961.621751:0:17025:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596961.621753:0:17025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596961.621755:0:17025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789596961.621786:0:17025:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789596961.633765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984845312:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789596961.658495:0:17025:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789596961.659765:0:17025:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789596961.659931:0:17087:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789596961.659935:0:17087:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789596961.662037:0:17088:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789596961.664614:0:17025:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789596961.664875:0:17088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789596961.666583:0:17089:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c7d837b7800 x1876527984845440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596961.666598:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000040:01000000:2.0:1789596961.667092:0:17025:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789596961.667143:0:17025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789596961.667729:0:17025:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789596961.667738:0:17025:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789596961.667775:0:17025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596961.669191:0:17088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789596961.670986:0:17088:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789596961.671142:0:17025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789596961.674320:0:17025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789596961.674574:0:17025:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789596961.679045:0:17025:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789596961.681140:0:17025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789596961.683180:0:17025:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789596961.683225:0:17025:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0dc419d7988 00100000:10000000:2.0:1789596961.683234:0:17025:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789596961.683877:0:17025:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789596961.683899:0:17025:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789596961.683920:0:17025:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789596961.683946:0:17025:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789596961.710218:0:17025:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789596961.711405:0:17025:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789596962.108901:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596962.621419:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596962.688754:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 10000000:01000000:0.0:1789596962.940833:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789596962.940842:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7ebfae6000 from 7 10000000:01000000:0.0:1789596962.940848:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596962.940918:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596962.940932:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596962.940945:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596962.940976:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984845568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596962.941097:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596962.941339:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596962.947058:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845568 00000100:00100000:3.0:1789596962.947080:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845568 00000100:00100000:2.0:1789596962.947275:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596962.947287:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+11:17043:x1876527984845568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596962.947306:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596962.947330:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfb09 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596962.947373:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596962.947404:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596962.947413:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dce00, rc 0) 00000100:00100000:2.0:1789596962.947496:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+12:17043:x1876527984845568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596962.947504:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789596962.948004:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984845568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596962.948024:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596962.948033:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596962.948323:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984845696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789596962.948451:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596962.948498:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596962.948626:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845696 00000100:00100000:2.0:1789596962.948632:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845696 00000100:00100000:2.0:1789596962.948740:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596962.948751:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17043:x1876527984845696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789596962.948945:0:17041:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789596962.948965:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789596962.948968:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789596962.950508:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17043:x1876527984845696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1751us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596962.950531:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789596962.957263:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984845696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789596962.958583:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789596962.958597:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596962.958611:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596963.141843:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596963.645414:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596963.711818:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1789596964.165970:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596964.732825:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1789596965.183821:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596965.760134:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1789596966.217823:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596966.781852:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000100:00080000:2.0:1789596966.846369:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789596966.846378:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789596966.846383:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596966.846392:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:2.0:1789596966.846399:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789596966.846414:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7ebaf7d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596966.846463:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e79f80 x1876527984845952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596966.846482:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596966.846486:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596966.846490:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596966.846494:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596966.846496:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789596966.846499:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789596966.846501:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7d83da9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596966.846508:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c7d83da9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596966.846519:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e79c00 x1876527984846080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596966.846546:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984845952:0@lo:38:kworker.0 00000100:00100000:1.0:1789596966.846593:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596966.846607:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984845824:0@lo:400:kworker.0 00000100:00100000:2.0:1789596966.846648:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596966.846649:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596966.848349:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845952 00000100:00100000:1.0:1789596966.848369:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845952 00000100:00100000:1.0:1789596966.848494:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596966.848503:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984845952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789596966.848524:0:17053:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789596966.854589:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984846080:0@lo:38:kworker.0 00000100:00100000:0.0:1789596966.854898:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845824 00000100:00100000:0.0:1789596966.854910:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845824 00000100:00100000:0.0:1789596966.855139:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596966.855151:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:3646:x1876527984845824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596966.855342:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:3646:x1876527984845824:12345-0@lo:400:kworker.0 Request processed in 192us (8690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596966.855351:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596966.855902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596966.858399:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984846080 00000100:00100000:2.0:1789596966.858424:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984846080 00000100:00100000:2.0:1789596966.860132:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596966.860161:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984846080:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789596966.860247:0:17048:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1789596966.860345:0:17048:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7b5398e289bbfb17 00000004:00100000:2.0:1789596966.860370:0:17048:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789596966.860556:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596966.860706:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876527984846080:12345-0@lo:38:kworker.0 Request processed in 558us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596966.860715:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596966.870925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984845824:0@lo:400:kworker.0 00010000:00080000:2.0:1789596966.871059:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7d83e79c00 x1876527984846080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789596966.871080:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789596966.871090:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789596966.871095:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789596966.871099:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789596966.871106:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984846080:0@lo:38:kworker.0 00000100:00100000:0.0:1789596966.877888:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984845952:12345-0@lo:38:kworker.0 Request processed in 29373us (31228us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789596966.877910:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789596966.878331:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596966.878339:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789596966.878344:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984845952:0@lo:38:kworker.0 00000001:02000400:1.0:1789596967.021193:0:17331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789596967.228974:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596967.813448:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000020:00000004:3.0:1789596968.093404:0:17383:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596968.093584:0:17383:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789596968.253856:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596968.829780:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000020:00000004:0.0:1789596969.154513:0:17434:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596969.154759:0:17434:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789596969.277092:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596969.854203:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1789596970.301596:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596970.879316:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1789596971.325626:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596971.908489:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000100:00080000:2.0:1789596971.964873:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789596971.964881:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789596971.964884:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596971.964893:0:479:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1789596971.964899:0:479:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789596971.964911:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7ebaf7d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596971.964945:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e79c00 x1876527984846336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596971.964957:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596971.964961:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596971.964963:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596971.964967:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789596971.964999:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596961/real 1789596961] req@ffff9c7d831b4a80 x1876527984843008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596971.965024:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d831b4a80 x1876527984843008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596971.965033:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596961/real 1789596961] req@ffff9c7d83e7bb80 x1876527984842880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596971.965044:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d83e7bb80 x1876527984842880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596971.965063:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846336:0@lo:38:kworker.0 00000100:00100000:2.0:1789596971.965125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789596971.965167:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596971.965179:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789596971.965183:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984843008:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789596971.965188:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596971.965193:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789596971.965196:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984842880:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789596971.965257:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984846464:0@lo:400:kworker.0 00000100:00100000:2.0:1789596971.965299:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596971.965318:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596971.965324:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984846208:0@lo:400:kworker.0 00000100:00100000:2.0:1789596971.965387:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596971.965422:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984846208 00000100:00100000:2.0:1789596971.965429:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984846208 00000100:00100000:2.0:1789596971.965484:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596971.965493:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:3645:x1876527984846208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596971.965543:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:3645:x1876527984846208:12345-0@lo:400:kworker.0 Request processed in 51us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596971.965549:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789596971.965578:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596971.965581:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789596971.965583:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596971.965586:0:479:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:2.0:1789596971.965589:0:479:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789596971.965594:0:479:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7ebaf79800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596971.965622:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e7b800 x1876527984846592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596971.965636:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596971.965639:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789596971.965641:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596971.965644:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:2.0:1789596971.965646:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789596971.965658:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596971.965672:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e79500 x1876527984846720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596971.965805:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984846208:0@lo:400:kworker.0 00000100:00100000:2.0:1789596971.965827:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846592:0@lo:8:kworker.0 00000400:00000100:2.0:1789596971.965854:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984846592 offset 0 length 520: 4 00000100:00100000:2.0:1789596971.965872:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846720:0@lo:8:kworker.0 00000400:00000100:2.0:1789596971.965890:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984846720 offset 0 length 520: 4 00000100:00100000:0.0:1789596971.966178:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984846464 00000100:00100000:0.0:1789596971.966184:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984846464 00000100:00100000:0.0:1789596971.966227:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596971.966235:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984846464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596971.966294:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984846464:12345-0@lo:400:kworker.0 Request processed in 60us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596971.966300:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789596971.966335:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7d83e79180 x1876527984846464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596971.966346:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984846464:0@lo:400:kworker.0 00000100:00100000:3.0:1789596971.968113:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984846336 00000100:00100000:3.0:1789596971.968126:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984846336 00000100:00100000:3.0:1789596971.968176:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596971.968184:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984846336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789596971.968205:0:17052:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789596972.008808:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984846336:12345-0@lo:38:kworker.0 Request processed in 40614us (43673us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789596972.008825:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789596972.008901:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596972.008906:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789596972.008911:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846336:0@lo:38:kworker.0 00010000:00010000:0.0:1789596972.350078:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596972.924962:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1789596973.374042:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596973.893891:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596973.958617:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1789596974.409827:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596974.974482:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1789596975.434378:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596975.996809:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1789596976.448129:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596977.020751:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000100:00080000:3.0:1789596977.085005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789596977.085013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789596977.085018:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596977.085026:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1789596977.085032:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789596977.085045:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7ebaf7d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596977.085068:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d825f5c00 x1876527984846976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596977.085095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596977.085099:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596977.085102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596977.085105:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789596977.085202:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984846848:0@lo:400:kworker.0 00000100:00100000:1.0:1789596977.085305:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596977.085375:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596977.085381:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984847104:0@lo:400:kworker.0 00000100:00100000:1.0:1789596977.085421:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596977.085624:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846976:0@lo:38:kworker.0 00000100:00100000:2.0:1789596977.085736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596977.085773:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847104 00000100:00100000:2.0:1789596977.085781:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847104 00000100:00100000:2.0:1789596977.085833:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596977.085842:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984847104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596977.085893:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984847104:12345-0@lo:400:kworker.0 Request processed in 52us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596977.085901:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596977.085980:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984846976 00000100:00100000:1.0:1789596977.085997:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984846976 00000100:00100000:1.0:1789596977.086029:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596977.086034:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984846976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789596977.086052:0:17053:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789596977.087417:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984846848 00000100:00100000:3.0:1789596977.087430:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984846848 00000100:00100000:3.0:1789596977.087478:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789596977.087487:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+12:3646:x1876527984846848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596977.087557:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+12:3646:x1876527984846848:12345-0@lo:400:kworker.0 Request processed in 71us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596977.087563:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789596977.087746:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7d825f4000 x1876527984847104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596977.087781:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984847104:0@lo:400:kworker.0 00000100:00100000:0.0:1789596977.087795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984846848:0@lo:400:kworker.0 00000100:00100000:2.0:1789596977.117162:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984846976:12345-0@lo:38:kworker.0 Request processed in 31117us (31416us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789596977.117182:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789596977.117393:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596977.117399:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789596977.117404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846976:0@lo:38:kworker.0 00010000:00010000:3.0:1789596977.468962:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789596977.793078:0:17779:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789596977.793082:0:17779:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789596977.793084:0:17779:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789596977.793222:0:17779:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7d8318b800 00000020:01000004:2.0:1789596977.794961:0:17779:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789596977.795002:0:17779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789596977.795023:0:17779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c7d820cb380) 00000020:00000080:2.0:1789596977.795041:0:17779:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789596977.857012:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789596977.857550:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789596977.862826:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789596977.863109:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789596977.864087:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789596977.864922:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789596977.865359:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789596977.865569:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789596977.865813:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789596977.866148:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789596977.866482:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789596977.866711:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789596977.867260:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789596977.867507:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789596977.871217:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.871556:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.871831:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.872165:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.872434:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.872646:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.873089:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.873320:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.875057:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.875727:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.876102:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.876420:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.876806:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.877167:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.877498:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.877810:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.878137:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789596977.878429:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.878864:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.879230:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.879520:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789596977.880204:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789596977.884088:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789596977.885977:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789596977.886437:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789596977.887072:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789596977.887459:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789596977.888144:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789596977.889095:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789596977.889493:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789596977.890049:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789596977.890482:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00080000:01000000:2.0:1789596977.892449:0:17779:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789596977.893379:0:17779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789596977.893395:0:17779:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789596977.893411:0:17779:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbfb25 00000020:01000004:2.0:1789596977.893420:0:17779:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789596977.893444:0:17779:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789596977.893448:0:17779:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789596977.893457:0:17779:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789596977.893490:0:17779:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789596977.893494:0:17779:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789596977.905521:0:17779:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789596977.905588:0:17779:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789596977.905593:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789596977.905595:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789596977.905596:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596977.905598:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596977.905599:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596977.905600:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596977.905601:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596977.905610:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596977.905611:0:17779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789596977.905616:0:17779:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789596977.905618:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596977.905619:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789596977.905620:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596977.905620:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596977.905621:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596977.905622:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596977.905623:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596977.905624:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596977.905624:0:17779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789596977.905664:0:17779:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789596977.906131:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596977.906237:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596977.906328:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e82b8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596977.906374:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847232 00000100:00100000:0.0:1789596977.906383:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847232 00000100:00100000:0.0:1789596977.906474:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596977.906485:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17779:x1876527984847232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789596977.906517:0:17040:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789596977.906521:0:17040:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789596977.906529:0:17040:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789596977.907155:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17779:x1876527984847232:12345-0@lo:253:mount.lustre.0 Request processed in 668us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596977.907164:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789596977.907377:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789596977.907392:0:17779:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789596977.907395:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789596977.907396:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789596977.907398:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596977.907399:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596977.907400:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596977.907401:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596977.907402:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789596977.907403:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596977.907404:0:17779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789596977.907428:0:17779:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7d8318b800 from lustre-MDT0001 10000000:01000000:1.0:1789596977.907456:0:17779:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789596977.907459:0:17779:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789596977.907467:0:17779:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7d83514d40 local copy 00010000:00010000:1.0:1789596977.907477:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596977.907573:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596977.907606:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596977.907673:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596977.907968:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847360 00000100:00100000:2.0:1789596977.907976:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847360 00000100:00100000:3.0:1789596977.908159:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596977.908168:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17779:x1876527984847360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596977.908318:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+12:17779:x1876527984847360:12345-0@lo:501:mount.lustre.0 Request processed in 150us (709us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596977.908326:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789596977.908435:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847360:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789596977.908452:0:17779:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789596977.908488:0:17779:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789596977.908496:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.908505:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596977.908531:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7d8318b800 10000000:01000000:1.0:1789596977.908535:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789596977.908540:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c7d83514d40 10000000:01000000:1.0:1789596977.908543:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789596977.908546:0:17779:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c7d83514d40 from 1 10000000:01000000:1.0:1789596977.908549:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789596977.908579:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.908587:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.908597:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596977.908611:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596977.908638:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596977.908905:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596977.909066:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847488 00000100:00100000:0.0:1789596977.909073:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847488 00000100:00100000:0.0:1789596977.909146:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596977.909156:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+12:17779:x1876527984847488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596977.909168:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596977.909191:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbfb33 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfb2c expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596977.909225:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbfb33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfb2c expref: 13 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596977.909238:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbfb33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfb2c expref: 13 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596977.909247:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743e00, rc 0) 00000100:00100000:0.0:1789596977.909294:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+13:17779:x1876527984847488:12345-0@lo:101:mount.lustre.0 Request processed in 140us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596977.909301:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789596977.909370:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596977.909383:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.909392:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596977.909415:0:17779:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789596977.909432:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.909438:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596977.909447:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7d8318b800 10000000:01000000:1.0:1789596977.909451:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789596977.909455:0:17779:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7d8318b800 from 1 10000000:01000000:1.0:1789596977.909457:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789596977.909472:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.909479:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.909486:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596977.909500:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596977.909526:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596977.909654:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596977.909873:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847616 00000100:00100000:3.0:1789596977.909878:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847616 00000100:00100000:3.0:1789596977.910197:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596977.910215:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+13:17779:x1876527984847616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596977.910227:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596977.910239:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbfb41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfb3a expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596977.910256:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbfb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfb3a expref: 14 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596977.910280:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbfb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfb3a expref: 14 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596977.910286:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81510200, rc 0) 00000100:00100000:3.0:1789596977.910376:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+14:17779:x1876527984847616:12345-0@lo:101:mount.lustre.0 Request processed in 170us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596977.910382:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789596977.910537:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596977.910550:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.910557:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596977.910577:0:17779:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789596977.910628:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.910636:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596977.910642:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789596977.910646:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789596977.910650:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7d8318b800 10000000:01000000:1.0:1789596977.910653:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789596977.910656:0:17779:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789596977.910658:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789596977.910674:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.910698:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.910705:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596977.910720:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596977.910762:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596977.910794:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596977.910906:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847744 00000100:00100000:0.0:1789596977.910911:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847744 00000100:00100000:0.0:1789596977.910943:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789596977.910950:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+14:17779:x1876527984847744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596977.910959:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596977.910968:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742400/0x7b5398e289bbfb4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfb48 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596977.910994:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742400/0x7b5398e289bbfb4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfb48 expref: 15 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596977.911003:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742400/0x7b5398e289bbfb4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfb48 expref: 15 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596977.911009:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742400, rc 0) 00000100:00100000:0.0:1789596977.911038:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984847744:12345-0@lo:101:mount.lustre.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596977.911053:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789596977.911256:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596977.911268:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596977.911282:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596977.913351:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789596977.914260:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596977.922277:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789596977.922346:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789596977.922365:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789596977.922377:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789596977.922388:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789596977.922400:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789596977.922413:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789596977.922425:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789596977.922441:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789596977.922460:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789596977.922476:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789596977.922491:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789596977.922506:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789596977.922521:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789596977.922535:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789596977.922549:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789596977.922563:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789596977.922575:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789596977.922587:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789596977.922599:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789596977.922612:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789596977.922625:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789596977.922637:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789596977.922665:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789596977.922672:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789596977.926472:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596977.926553:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596977.926610:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96456f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596977.927882:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984847872 00000100:00100000:3.0:1789596977.927904:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984847872 00000100:00100000:3.0:1789596977.927964:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596977.927974:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984847872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596977.928320:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984847872:12345-0@lo:501:mount.lustre.0 Request processed in 347us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596977.928328:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789596977.928439:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984847872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596977.928504:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984848000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596977.928551:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596977.928628:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96456f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596977.932898:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848000 00000100:00100000:1.0:1789596977.932927:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848000 00000100:00100000:1.0:1789596977.933023:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789596977.933036:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984848000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596977.934173:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984848000:12345-0@lo:503:mount.lustre.0 Request processed in 1134us (5616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596977.934183:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596977.937241:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984848000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789596977.938082:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789596977.938180:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984848128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596977.938272:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596977.938401:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e958d7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596977.938568:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848128 00000100:00100000:3.0:1789596977.938577:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848128 00000100:00100000:3.0:1789596977.938665:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596977.938708:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984848128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596977.939916:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984848128:12345-0@lo:502:mount.lustre.0 Request processed in 1236us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596977.939929:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789596977.940238:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984848128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789596977.940473:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789596977.940505:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789596977.940521:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789596977.940536:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789596977.940552:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789596977.940567:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789596977.940580:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789596977.940594:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789596977.940608:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789596977.940622:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789596977.940636:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789596977.940650:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789596977.940662:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789596977.940674:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789596977.941075:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789596977.941104:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789596977.941119:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789596977.941131:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789596977.941143:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789596977.941156:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789596977.941169:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789596977.941182:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789596977.941196:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789596977.941222:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789596977.941238:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789596977.941251:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789596977.941265:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789596977.941278:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789596977.941292:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789596977.941305:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789596977.941317:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789596977.941329:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789596977.941345:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789596977.941359:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789596977.941373:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789596977.941387:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789596977.941400:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789596977.941413:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789596977.941427:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789596977.941441:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789596977.941454:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789596977.941468:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789596977.941480:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789596977.941492:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789596977.941539:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984848256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596977.941611:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596977.941756:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596977.942146:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848256 00000100:00100000:0.0:1789596977.942155:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848256 00000100:00100000:0.0:1789596977.942223:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789596977.942233:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984848256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596977.942465:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984848256:12345-0@lo:502:mount.lustre.0 Request processed in 233us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596977.942474:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789596977.942551:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984848256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789596977.942629:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789596977.942641:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789596977.944057:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596977.944075:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596977.944077:0:17783:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789596977.944085:0:17783:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789596977.944088:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596977.944104:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c7ebf9919c0) 00000020:00000080:1.0:1789596977.944128:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789596977.944134:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789596977.944237:0:17783:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789596977.944245:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbfb5d 00000020:00000080:1.0:1789596977.945173:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789596977.945181:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596977.945186:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596977.945188:0:17783:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789596977.945191:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596977.945195:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596977.945196:0:17783:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789596977.945199:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596977.945222:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c7ebf990000) 00000020:00000080:1.0:1789596977.945237:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789596977.945242:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789596977.945243:0:17783:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789596977.945246:0:17783:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789596977.945252:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789596977.945327:0:17783:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d8318b800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789596977.945349:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c7ebbcb3380) 00000020:00000080:1.0:1789596977.945359:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789596977.945426:0:17783:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789596977.945432:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfb72 00000020:00000080:1.0:1789596977.945529:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789596977.945537:0:17783:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789596977.945541:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7b5398e289bbfb79 00080000:01000000:1.0:1789596977.945546:0:17783:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789596977.945556:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbfb80 00000100:00100000:2.0:1789596978.048991:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1789596978.056191:0:17783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789596978.057661:0:17783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1789596978.059580:0:17783:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789596978.064193:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789596978.064218:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596978.064226:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.064227:0:17783:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789596978.064231:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596978.064251:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.064253:0:17783:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789596978.064259:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789596978.064265:0:17783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:3.0:1789596978.064295:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596978.064311:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c7ebb188000) 00000020:00000080:3.0:1789596978.064337:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789596978.064344:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789596978.064428:0:17783:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789596978.064436:0:17783:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789596978.064443:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbfb8e 00010000:00080000:3.0:1789596978.064481:0:17783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e85f79000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596978.074290:0:17783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789596978.079406:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789596978.079423:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789596978.079461:0:17783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789596978.079484:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfb95 00000100:00080000:3.0:1789596978.079494:0:17783:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596978.079506:0:17783:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c7e85f79000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789596978.080387:0:17783:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d825f4e00 x1876527984848384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596978.080417:0:17783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789596978.080503:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596978.080509:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.080511:0:17783:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789596978.080514:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789596978.080519:0:17783:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789596978.080521:0:17783:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789596978.080522:0:17783:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789596978.080523:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789596978.080527:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.080552:0:17783:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789596978.080556:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596978.080562:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.080563:0:17783:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789596978.080567:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789596978.080612:0:17783:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789596978.080629:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596978.080633:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.080634:0:17783:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789596978.080637:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789596978.080638:0:17783:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789596978.080640:0:17783:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789596978.080641:0:17783:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789596978.080643:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789596978.080645:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.080646:0:17783:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789596978.080648:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789596978.080651:0:17783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789596978.080654:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596978.080656:0:17783:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789596978.080658:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789596978.080662:0:17783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:3.0:1789596978.080706:0:17783:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789596978.080710:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596978.080726:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c7ebb18b380) 00000100:00100000:0.0:1789596978.080861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984848384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596978.080945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596978.081037:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848384 00000100:00100000:0.0:1789596978.081044:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848384 00000100:00100000:0.0:1789596978.081076:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596978.081083:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984848384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789596978.081107:0:17052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1789596978.081158:0:17052:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfb9c 00000004:00100000:0.0:1789596978.081177:0:17052:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789596978.081183:0:17052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:3.0:1789596978.081472:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789596978.081482:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789596978.081568:0:17783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789596978.081576:0:17783:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789596978.081583:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbfbaa 00010000:00080000:3.0:1789596978.081615:0:17783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb5584800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789596978.081897:0:17783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1789596978.083864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789596978.083876:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789596978.083882:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596978.083901:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:1.0:1789596978.083906:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789596978.083921:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7ebaf7d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596978.083997:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b5f80 x1876527984848512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596978.084019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596978.084023:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596978.084026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596978.084037:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789596978.084728:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984848512:0@lo:38:kworker.0 00000100:00100000:0.0:1789596978.084812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596978.084866:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984848640:0@lo:400:kworker.0 00000100:00100000:0.0:1789596978.084907:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596978.084960:0:17053:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789596978.084968:0:17053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789596978.085004:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848640 00000100:00100000:0.0:1789596978.085012:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848640 00000100:00100000:0.0:1789596978.085280:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596978.085290:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984848640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596978.085343:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984848640:12345-0@lo:400:kworker.0 Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.085349:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789596978.085398:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7d831b7480 x1876527984848640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596978.085412:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984848640:0@lo:400:kworker.0 00000040:01000000:2.0:1789596978.088739:0:17783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789596978.088863:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848512 00000100:00100000:3.0:1789596978.088881:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848512 00000040:01000000:2.0:1789596978.092599:0:17783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1789596978.096611:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596978.096624:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984848512:12345-0@lo:38:kworker.0 00000040:00080000:2.0:1789596978.097307:0:17783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596978.097423:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984848512:12345-0@lo:38:kworker.0 Request processed in 797us (12607us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789596978.097434:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789596978.097994:0:17052:0:(import.c:65:import_set_state_nolock()) ffff9c7eb98c5000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1789596978.098403:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789596978.098613:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1789596978.099331:0:17789:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789596978.099337:0:17789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789596978.100236:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789596978.100253:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789596978.100309:0:17783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789596978.100334:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfbb1 00000100:00080000:2.0:1789596978.100344:0:17783:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596978.100356:0:17783:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb5584800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596978.100394:0:17783:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e78380 x1876527984848768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596978.100413:0:17783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789596978.100537:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.100542:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.100544:0:17783:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789596978.100547:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789596978.100550:0:17783:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789596978.100551:0:17783:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789596978.100553:0:17783:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789596978.100554:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789596978.100557:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.100559:0:17783:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789596978.100561:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596978.100566:0:17783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789596978.100569:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.100570:0:17783:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789596978.100573:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789596978.100587:0:17783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789596978.100613:0:17783:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789596978.100616:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596978.100627:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c7d820c99c0) 00000020:00000080:2.0:1789596978.100640:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789596978.100644:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789596978.100724:0:17783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789596978.100742:0:17783:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789596978.100748:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bbfbbf 00010000:00080000:2.0:1789596978.100778:0:17783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e859ea000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789596978.101170:0:17783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789596978.101256:0:17783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789596978.101272:0:17783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789596978.101556:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596978.101566:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596978.101572:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789596978.101576:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984848512:0@lo:38:kworker.0 00000100:00100000:0.0:1789596978.101608:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984848768:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789596978.101657:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984848768 offset 0 length 520: 4 00000100:00100000:1.0:1789596978.102971:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984848384:12345-0@lo:38:llog_process_th.0 Request processed in 21875us (22015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.103144:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596978.103156:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789596978.103166:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789596978.103180:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789596978.103184:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e85f79000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596978.103201:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984848384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789596978.103268:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596978.103643:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984848896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596978.103727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596978.103810:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984848896 00000100:00100000:1.0:1789596978.103819:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984848896 00000100:00100000:1.0:1789596978.103865:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596978.103873:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984848896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596978.103928:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00080000:3.0:1789596978.104727:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596978.104743:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596978.104746:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596978.104749:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789596978.106111:0:17783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596978.106476:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789596978.106661:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1789596978.107504:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984848896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3622us (3767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596978.107520:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596978.107856:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984848896:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789596978.108216:0:17791:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789596978.108223:0:17791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789596978.110379:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789596978.110396:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789596978.110444:0:17783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789596978.110469:0:17783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfbc6 00000100:00080000:2.0:1789596978.110480:0:17783:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596978.110491:0:17783:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596978.110530:0:17783:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e78a80 x1876527984849024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596978.110568:0:17783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789596978.110628:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.110632:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.110634:0:17783:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789596978.110637:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596978.110641:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.110642:0:17783:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596978.110645:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596978.110647:0:17783:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789596978.110663:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.110666:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.110667:0:17783:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789596978.110669:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596978.110671:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.110672:0:17783:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789596978.110703:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789596978.110861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984849024:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789596978.110936:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984849024 offset 0 length 520: 4 00000020:01000000:2.0:1789596978.111255:0:17783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.111261:0:17783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.111262:0:17783:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789596978.111267:0:17783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1789596978.111459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596978.111464:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596978.111468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596978.111471:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789596978.111556:0:17779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789596978.111589:0:17779:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789596978.111613:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.111625:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596978.111634:0:17779:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d8318b800 from 1 10000000:01000000:0.0:1789596978.111638:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596978.111673:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.111945:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.111957:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596978.112056:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789596978.112108:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596978.112143:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e3519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596978.112194:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849152 00000100:00100000:2.0:1789596978.112202:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849152 00000100:00100000:2.0:1789596978.112260:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789596978.112268:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+15:17779:x1876527984849152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596978.112281:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596978.112296:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfbcd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596978.112318:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 16 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596978.112329:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 16 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596978.112338:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc600, rc 0) 00000100:00100000:2.0:1789596978.112385:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+16:17779:x1876527984849152:12345-0@lo:101:mount.lustre.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596978.112391:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789596978.112510:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596978.112525:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.112545:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596978.113520:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849280:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789596978.113819:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596978.113858:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.114109:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849280 00000100:00100000:0.0:1789596978.114118:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849280 00000100:00100000:0.0:1789596978.114173:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789596978.114183:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+16:17779:x1876527984849280:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789596978.114213:0:17039:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789596978.114237:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789596978.114240:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789596978.114503:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+16:17779:x1876527984849280:12345-0@lo:256:mount.lustre.0 Request processed in 321us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.114511:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789596978.115076:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849280:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789596978.115816:0:17779:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789596978.115840:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.115853:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596978.115862:0:17779:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d8318b800 from 1 10000000:01000000:1.0:1789596978.115865:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596978.116076:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.116085:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.116108:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596978.116131:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596978.116188:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596978.116241:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.116364:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849408 00000100:00100000:0.0:1789596978.116371:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849408 00000100:00100000:0.0:1789596978.116414:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789596978.116423:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+16:17779:x1876527984849408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596978.116438:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596978.116449:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfbdb expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.116481:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.116490:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596978.116498:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743800, rc 0) 00000100:00100000:0.0:1789596978.116547:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849408:12345-0@lo:101:mount.lustre.0 Request processed in 125us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.116554:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789596978.116824:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596978.116839:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.116848:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596978.117141:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596978.117175:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596978.117217:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596978.117245:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.117321:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849536 00000100:00100000:0.0:1789596978.117327:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849536 00000100:00100000:0.0:1789596978.117353:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789596978.117360:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596978.117488:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849536:12345-0@lo:501:mount.lustre.0 Request processed in 128us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.117494:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789596978.118275:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596978.118316:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596978.118367:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596978.118444:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596978.118867:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849664 00000100:00100000:3.0:1789596978.118876:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849664 00000100:00100000:3.0:1789596978.119071:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789596978.119082:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596978.119198:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849664:12345-0@lo:503:mount.lustre.0 Request processed in 119us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.119217:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596978.119289:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849664:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789596978.119727:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596978.119811:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596978.119855:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596978.120292:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.120379:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849792 00000100:00100000:0.0:1789596978.120385:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849792 00000100:00100000:0.0:1789596978.120420:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789596978.120428:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596978.120549:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849792:12345-0@lo:502:mount.lustre.0 Request processed in 122us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.120558:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596978.120708:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789596978.120950:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789596978.120992:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1789596978.121009:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1789596978.121022:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1789596978.121035:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1789596978.121047:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1789596978.121075:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1789596978.121088:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1789596978.121099:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789596978.121111:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1789596978.121124:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1789596978.121147:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596978.121183:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596978.121202:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.121449:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984849920 00000100:00100000:0.0:1789596978.121454:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984849920 00000100:00100000:0.0:1789596978.121485:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789596978.121492:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596978.121592:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984849920:12345-0@lo:502:mount.lustre.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.121599:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789596978.121826:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984849920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789596978.121874:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1789596978.121882:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789596978.122448:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596978.122458:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122460:0:17793:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789596978.122468:0:17793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7d8318b800 00000020:00000080:2.0:1789596978.122471:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596978.122480:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.122482:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122483:0:17793:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789596978.122486:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596978.122488:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122489:0:17793:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789596978.122492:0:17793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7d8318b800 00000020:00000080:2.0:1789596978.122494:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596978.122559:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.122563:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122564:0:17793:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789596978.122567:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596978.122570:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122571:0:17793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789596978.122574:0:17793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7d8318b800 00000020:00000080:2.0:1789596978.122576:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596978.122593:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.122596:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122597:0:17793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789596978.122599:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596978.122601:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122602:0:17793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789596978.122605:0:17793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7d8318b800 00000020:00000080:2.0:1789596978.122606:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596978.122636:0:17793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596978.122638:0:17793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596978.122639:0:17793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789596978.122642:0:17793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789596978.128713:0:17779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789596978.128783:0:17779:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596978.128814:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.128828:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596978.128886:0:17779:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789596978.128890:0:17779:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7d8318b800 10000000:01000000:1.0:1789596978.128899:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7d8318b800 10000000:01000000:1.0:1789596978.128903:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789596978.128910:0:17779:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7d8318b800 from 1 10000000:01000000:1.0:1789596978.128913:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596978.128949:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.128956:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.128967:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596978.129174:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850048:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596978.129264:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596978.129317:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596978.129834:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850048 00000100:00100000:1.0:1789596978.129842:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850048 00000100:00100000:1.0:1789596978.129895:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789596978.129903:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17779:x1876527984850048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596978.129917:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596978.129930:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a0800/0x7b5398e289bbfbf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfbe9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.129954:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a0800/0x7b5398e289bbfbf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfbe9 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.129965:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a0800/0x7b5398e289bbfbf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfbe9 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596978.130115:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0800, rc 0) 00000100:00100000:1.0:1789596978.130176:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850048:12345-0@lo:101:mount.lustre.0 Request processed in 273us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596978.130182:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789596978.130290:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596978.130307:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.130316:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596978.134550:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789596978.135263:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596978.135479:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789596978.135511:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1789596978.135526:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1789596978.136099:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1789596978.136119:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1789596978.136133:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1789596978.136147:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1789596978.136161:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1789596978.136192:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1789596978.136217:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1789596978.136233:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1789596978.136247:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1789596978.136260:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1789596978.136272:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1789596978.136284:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1789596978.136297:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1789596978.136311:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1789596978.136323:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1789596978.136335:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1789596978.136348:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1789596978.136363:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1789596978.136377:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1789596978.136391:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1789596978.136405:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1789596978.136432:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1789596978.136448:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1789596978.136460:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1789596978.136472:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1789596978.136493:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1789596978.136498:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789596978.138327:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596978.138399:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.138448:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.138639:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850176 00000100:00100000:0.0:1789596978.138647:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850176 00000100:00100000:0.0:1789596978.138723:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789596978.138797:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596978.138948:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850176:12345-0@lo:501:mount.lustre.0 Request processed in 216us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.138955:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596978.139175:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596978.139221:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596978.139264:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.139294:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596978.140935:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850304 00000100:00100000:0.0:1789596978.140948:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850304 00000100:00100000:0.0:1789596978.141021:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596978.141033:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596978.141224:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850304:12345-0@lo:503:mount.lustre.0 Request processed in 194us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.141232:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789596978.143182:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789596978.143727:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596978.143936:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596978.144081:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.144131:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850432 00000100:00100000:3.0:1789596978.144137:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850432 00000100:00100000:3.0:1789596978.144186:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596978.144197:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596978.144317:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850432:12345-0@lo:502:mount.lustre.0 Request processed in 122us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.144325:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596978.144378:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596978.144396:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596978.145852:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789596978.145903:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789596978.145919:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789596978.145933:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789596978.145946:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789596978.145960:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789596978.145975:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789596978.147148:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789596978.147163:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789596978.147188:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789596978.147217:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789596978.147231:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789596978.147242:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789596978.147253:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789596978.147264:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789596978.147275:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789596978.147286:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789596978.147296:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789596978.147307:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789596978.147317:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789596978.147328:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789596978.147342:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789596978.147355:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789596978.147367:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789596978.147378:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789596978.147401:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789596978.147413:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789596978.147424:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789596978.147435:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789596978.147445:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789596978.147456:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789596978.147466:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789596978.147477:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789596978.147487:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789596978.147498:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789596978.147508:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789596978.147518:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789596978.147529:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789596978.148097:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789596978.148112:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789596978.148123:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789596978.148146:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789596978.148158:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789596978.148176:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789596978.148187:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789596978.148198:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789596978.148221:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789596978.148235:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789596978.148291:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596978.148369:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.148417:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850560 00000100:00100000:3.0:1789596978.148423:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850560 00000100:00100000:3.0:1789596978.148462:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789596978.148470:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596978.148576:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850560:12345-0@lo:502:mount.lustre.0 Request processed in 106us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.148584:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789596978.148632:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596978.148653:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596978.148844:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789596978.148863:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789596978.148879:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596978.148907:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.148923:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596978.149843:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850688 00000100:00100000:1.0:1789596978.149854:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850688 00000100:00100000:1.0:1789596978.149901:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789596978.149910:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596978.150052:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850688:12345-0@lo:502:mount.lustre.0 Request processed in 144us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596978.150061:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789596978.151774:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596978.151887:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789596978.151913:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789596978.154153:0:17797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789596978.154173:0:17797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c7ebbcb0000) 00000020:00000080:1.0:1789596978.154194:0:17797:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789596978.154291:0:17797:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d8318b800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789596978.154296:0:17797:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7d8318b800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789596978.154298:0:17797:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7d8318b800 3 00010000:00080000:1.0:1789596978.154335:0:17797:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e90d3c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789596978.155950:0:17797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789596978.156132:0:17797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789596978.156164:0:17797:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789596978.156174:0:17797:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7b5398e289bbfbfe 00000100:00080000:1.0:1789596978.156183:0:17797:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596978.156193:0:17797:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c7e90d3c800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596978.156269:0:17797:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4700 x1876527984850816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596978.156302:0:17797:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789596978.156922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596978.156928:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596978.156939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596978.156941:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789596978.157142:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1789596978.157308:0:17779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789596978.157339:0:17779:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596978.157356:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.157368:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596978.157422:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596978.157424:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789596978.157425:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596978.157426:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596978.157427:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596978.157428:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596978.157429:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596978.157431:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596978.157432:0:17779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596978.157436:0:17779:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789596978.157439:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596978.157440:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789596978.157441:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596978.157442:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596978.157443:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596978.157444:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596978.157445:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596978.157446:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596978.157447:0:17779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596978.157466:0:17779:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789596978.157484:0:17779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596978.157554:0:17779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.157590:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850944 00000100:00100000:3.0:1789596978.157603:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850944 00000100:00100000:3.0:1789596978.157716:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789596978.157727:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789596978.157768:0:17041:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789596978.157783:0:17041:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789596978.158058:0:17779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e811ca180 going to sleep for 11 seconds 00000001:00100000:3.0:1789596978.159189:0:17026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789596978.159238:0:17041:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789596978.159250:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789596978.159389:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789596978.159395:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789596978.159417:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159433:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159442:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 18 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159449:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159484:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 18 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159503:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 18 pid: 17041 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.159516:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984851072:0@lo:104: 00000100:00100000:3.0:1789596978.159573:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596978.159620:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159628:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 18 pid: 17039 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.159635:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984851200:0@lo:104: 00000100:00100000:3.0:1789596978.159655:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.159671:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596978.159792:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851072 00000100:00100000:3.0:1789596978.159800:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851072 00000100:00100000:3.0:1789596978.159829:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851200 00000100:00100000:3.0:1789596978.159832:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851200 00000100:00100000:3.0:1789596978.159844:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596978.159852:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+4:17063:x1876527984851072:12345-0@lo:104: 00010000:00010000:3.0:1789596978.159864:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159913:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596978.159919:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+4:17063:x1876527984851072:12345-0@lo:104: Request processed in 68us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.159925:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596978.159941:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596978.159946:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984851200:12345-0@lo:104: 00010000:00010000:3.0:1789596978.159953:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.159983:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789596978.159987:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984851200:12345-0@lo:104: Request processed in 42us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.160000:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789596978.160019:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596978.160026:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160032:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596978.160035:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160044:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596978.160050:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596978.160056:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596978.160081:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160087:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596978.160107:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160113:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d83742e00/0x7b5398e289bbfbcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfbd4 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160125:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596978.160128:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160143:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596978.160146:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160152:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596978.160158:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596978.160162:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596978.160175:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160181:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596978.160187:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160193:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d83742000/0x7b5398e289bbfb09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfb10 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160217:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596978.160219:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596978.160221:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596978.160229:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596978.160251:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984851328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596978.160283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.160302:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596978.160308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984851456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596978.160337:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.160365:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851328 00000100:00100000:3.0:1789596978.160369:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851328 00010000:00010000:3.0:1789596978.160388:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 19 pid: 17041 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.160407:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851456 00000100:00100000:3.0:1789596978.160410:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851456 00010000:00010000:3.0:1789596978.160420:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 20 pid: 17039 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.160430:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596978.160436:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+20:3646:x1876527984851328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596978.160446:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596978.160450:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 20 pid: 17041 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160459:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 20 pid: 17041 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160474:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596978.160507:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+20:3646:x1876527984851328:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.160514:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596978.160526:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596978.160532:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+19:3646:x1876527984851456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596978.160540:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596978.160544:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 19 pid: 17039 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160562:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 19 pid: 17039 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160573:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160582:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789596978.160594:0:17031:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007435860s 00010000:00010000:3.0:1789596978.160599:0:17031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160606:0:17031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160613:0:17031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160619:0:17031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160624:0:17031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596978.160628:0:17031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160635:0:17031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160643:0:17031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.160659:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596978.161909:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+19:3646:x1876527984851456:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.161921:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596978.162078:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17779:x1876527984850944:12345-0@lo:253:mount.lustre.0 Request processed in 4352us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.162087:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789596978.162157:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984851456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596978.162168:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984851328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596978.162217:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dc600/0x7b5398e289bbfbd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfbcd expref: 17 pid: 17041 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.162228:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984851072:0@lo:104: 00010000:00010000:3.0:1789596978.162238:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bbfb10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfb09 expref: 16 pid: 17039 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.162246:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984851200:0@lo:104: 00010000:00010000:3.0:1789596978.162262:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.162272:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.162278:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596978.162295:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510e00/0x7b5398e289bbfc05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596978.162332:0:17779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:17779:1876527984850944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789596978.162342:0:17779:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789596978.162346:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596978.162348:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789596978.162349:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596978.162350:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596978.162351:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596978.162352:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596978.162354:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596978.162356:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596978.162357:0:17779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789596978.162366:0:17779:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789596978.168276:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984850816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596978.168358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596978.168428:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984850816 00000100:00100000:0.0:1789596978.168436:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984850816 00000100:00100000:0.0:1789596978.168472:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596978.168480:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984850816:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789596978.168509:0:17047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1789596978.168557:0:17047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7b5398e289bbfc0c 00000004:00100000:0.0:1789596978.168574:0:17047:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789596978.168612:0:17047:0:(import.c:65:import_set_state_nolock()) ffff9c7e87561800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596978.168668:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876527984850816:12345-0@lo:38:llog_process_th.0 Request processed in 186us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596978.168701:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789596978.168751:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7d831b4700 x1876527984850816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596978.168762:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596978.168772:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789596978.168780:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789596978.168786:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789596978.168788:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e90d3c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596978.168794:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984850816:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1789596978.183349:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789596978.183599:0:17804:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789596978.183604:0:17804:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789596978.188878:0:17805:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789596978.189074:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1789596978.190773:0:17805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596978.190833:0:17807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17807:1876527984851584:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789596978.190914:0:17807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.190951:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851584 00000100:00100000:3.0:1789596978.190958:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851584 00000040:01000000:2.0:1789596978.191292:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789596978.191333:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596978.192107:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596978.192120:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17807:x1876527984851584:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789596978.192228:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17807:x1876527984851584:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596978.192236:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596978.192266:0:17807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83f11b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596978.192290:0:17807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17807:1876527984851584:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789596978.192319:0:17807:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789596978.192356:0:17807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17807:1876527984851712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789596978.192400:0:17807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.192417:0:17807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ea64cf300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596978.193307:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851712 00000100:00100000:1.0:1789596978.193320:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851712 00000100:00100000:1.0:1789596978.193379:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789596978.193389:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17807:x1876527984851712:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789596978.193539:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17807:x1876527984851712:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 151us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596978.193546:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00000080:2.0:1789596978.193900:0:17779:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789596978.193915:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789596978.194117:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596978.194711:0:17807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17807:1876527984851712:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789596978.194849:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789596978.194974:0:17805:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789596978.195121:0:17807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17807:1876527984851840:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789596978.195176:0:17807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.195217:0:17807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ea64cfb40 going to sleep for 11 seconds 00000040:00080000:2.0:1789596978.197467:0:17779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789596978.198636:0:17779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789596978.199440:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789596978.199583:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789596978.203806:0:17779:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1789596978.203923:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851840 00000100:00100000:1.0:1789596978.203935:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851840 00000100:00100000:1.0:1789596978.203995:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596978.204006:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17807:x1876527984851840:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789596978.204123:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17807:x1876527984851840:12345-0@lo:900:lod0001_rec0000.0 Request processed in 119us (8947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596978.204131:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789596978.204555:0:17807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7d825f7480 x1876527984851840/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789596994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596978.204571:0:17807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17807:1876527984851840:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789596978.204646:0:17807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17807:1876527984851968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789596978.204879:0:17807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596978.205061:0:17807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ea64cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789596978.205144:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984851968 00000100:00100000:1.0:1789596978.205150:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984851968 00000100:00100000:1.0:1789596978.205202:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596978.205220:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17807:x1876527984851968:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789596978.205346:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17807:x1876527984851968:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596978.205354:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000001:00000004:2.0:1789596978.207298:0:17779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789596978.207345:0:17807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17807:1876527984851968:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789596978.207407:0:17807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596978.211408:0:17807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789596978.211513:0:17807:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789596978.211518:0:17807:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1789596978.212801:0:17779:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789596978.212826:0:17779:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc0dc41c33988 00100000:10000000:2.0:1789596978.212833:0:17779:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789596978.213542:0:17779:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789596978.213573:0:17779:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789596978.213588:0:17779:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789596978.213605:0:17779:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789596978.239007:0:17779:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596978.239282:0:17779:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789596978.492962:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596979.069551:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000040:00080000:2.0:1789596979.198644:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789596979.516993:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789596979.900924:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789596979.900933:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d8318b800 from 8 10000000:01000000:3.0:1789596979.900945:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789596979.900988:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596979.901000:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596979.901014:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596979.901040:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596979.901109:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596979.901167:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596979.901262:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852096 00000100:00100000:0.0:1789596979.901270:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852096 00000100:00100000:0.0:1789596979.901333:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596979.901343:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+16:17043:x1876527984852096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596979.901355:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596979.901368:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc13 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596979.901405:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596979.901417:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596979.901427:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743000, rc 0) 00000100:00100000:0.0:1789596979.901478:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984852096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596979.901486:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789596979.901823:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596979.901837:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596979.901846:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596979.901895:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789596979.901926:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596979.901951:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596979.902700:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852224 00000100:00100000:0.0:1789596979.902710:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852224 00000100:00100000:0.0:1789596979.902767:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596979.902777:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984852224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789596979.902799:0:17041:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596979.902817:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596979.902820:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789596979.902914:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984852224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596979.902922:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789596979.903272:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789596979.903328:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596979.903338:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596979.903348:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596979.903367:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596979.903370:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7ebfae6000 from 8 10000000:01000000:2.0:1789596979.903372:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596979.903399:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596979.903406:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596979.903415:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596979.903432:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596979.903463:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596979.903499:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596979.903721:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852352 00000100:00100000:3.0:1789596979.903726:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852352 00000100:00100000:3.0:1789596979.903756:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789596979.903764:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984852352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596979.903775:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596979.903794:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc21 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596979.903816:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596979.903827:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596979.903835:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81511400, rc 0) 00000100:00100000:3.0:1789596979.903864:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984852352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596979.903870:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789596979.904007:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596979.904020:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596979.904029:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596979.904069:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789596979.904099:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596979.904125:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596979.904210:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852480 00000100:00100000:0.0:1789596979.904215:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852480 00000100:00100000:0.0:1789596979.904242:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789596979.904247:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984852480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789596979.904259:0:17041:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596979.904272:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596979.904275:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789596979.904349:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984852480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596979.904355:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789596979.904426:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984852480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789596979.904463:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596979.904473:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596979.904480:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596980.093752:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000040:00080000:2.0:1789596980.224764:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789596980.542488:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596981.116883:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1789596981.572197:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596982.142732:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1789596982.589193:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596983.102039:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789596983.165016:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1789596983.231204:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984852608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789596983.231279:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596983.231378:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852608 00000100:00100000:1.0:1789596983.231387:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852608 00000100:00100000:1.0:1789596983.231448:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596983.231458:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984852608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596983.231496:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789596983.234882:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984852608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3414us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596983.234898:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789596983.236239:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789596983.236247:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789596983.236251:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596983.236269:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7ebaf7d800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789596983.236304:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e78700 x1876527984852864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596983.236328:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596983.236332:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596983.236335:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596983.236339:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596983.236362:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596983.236365:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596983.236368:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596983.236371:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789596983.236405:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984852736:0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.236478:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596983.236533:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984852864:0@lo:38:kworker.0 00000100:00100000:2.0:1789596983.236560:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596983.236596:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984852992:0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.236621:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596983.236638:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596983.236644:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984853120:0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.236667:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596983.236979:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852736 00000100:00100000:2.0:1789596983.236987:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852736 00000100:00100000:2.0:1789596983.237026:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789596983.237034:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:3645:x1876527984852736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.237075:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:3645:x1876527984852736:12345-0@lo:400:kworker.0 Request processed in 42us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596983.237082:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789596983.237112:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852992 00000100:00100000:2.0:1789596983.237115:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852992 00000100:00100000:2.0:1789596983.237147:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984853120 00000100:00100000:2.0:1789596983.237150:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984853120 00000100:00100000:2.0:1789596983.237173:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596983.237179:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984852992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.237211:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984852992:12345-0@lo:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596983.237216:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596983.237226:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596983.237232:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984853120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.237267:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984853120:12345-0@lo:400:kworker.0 Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596983.237273:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789596983.237318:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d83e7b480 x1876527984853120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596983.237330:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984853120:0@lo:400:kworker.0 00010000:00080000:2.0:1789596983.237340:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d83e7a300 x1876527984852992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596983.237347:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984852992:0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.237370:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984852736:0@lo:400:kworker.0 00000100:00100000:2.0:1789596983.237398:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984852864 00000100:00100000:2.0:1789596983.237402:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984852864 00000100:00100000:2.0:1789596983.237420:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596983.237424:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984852864:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789596983.237447:0:17788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:2.0:1789596983.237475:0:17788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfc2f 00000004:00100000:2.0:1789596983.237488:0:17788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789596983.237494:0:17788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789596983.247565:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984852608:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789596983.248495:0:17788:0:(import.c:65:import_set_state_nolock()) ffff9c7e87565800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596983.248805:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984852864:12345-0@lo:38:kworker.0 Request processed in 11378us (12242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596983.248817:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789596983.259499:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789596983.259517:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789596983.259524:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789596983.259529:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789596983.259563:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008b658bcf): req@ffff9c7d837b7800 x1876527984845440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596983.259585:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984852864:0@lo:38:kworker.0 00000100:00100000:1.0:1789596983.259815:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596983.259831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984853248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596983.260376:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596983.260423:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984853248 00000100:00100000:1.0:1789596983.260429:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984853248 00000100:00100000:1.0:1789596983.260474:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596983.260482:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984853248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596983.260516:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789596983.260561:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984853248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596983.260567:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596983.260604:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984853248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596983.264491:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596983.264566:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596983.264718:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984845440 00000100:00100000:1.0:1789596983.264728:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984845440 00000100:00100000:1.0:1789596983.264783:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596983.264793:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17089:x1876527984845440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789596983.264905:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17089:x1876527984845440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596983.264913:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596983.264954:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1876527984845440:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789596983.265012:0:17089:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789596983.265060:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1876527984853376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789596983.265098:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596983.265125:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596983.265152:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984853376 00000100:00100000:1.0:1789596983.265156:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984853376 00000100:00100000:1.0:1789596983.265189:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596983.265195:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1876527984853376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789596983.265291:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1876527984853376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596983.265298:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596983.265323:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1876527984853376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789596983.265384:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1876527984853504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789596983.265404:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596983.265417:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e85652cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596983.265428:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984853504 00000100:00100000:1.0:1789596983.265431:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984853504 00000100:00100000:1.0:1789596983.265448:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596983.265453:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1876527984853504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789596983.265493:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1876527984853504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596983.265500:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596983.265520:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1876527984853504:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789596983.265558:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596983.267613:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789596983.267738:0:17089:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1789596983.267744:0:17089:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789596983.613780:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789596983.634515:0:18049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789596984.638966:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789596984.837407:0:18102:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789596984.838028:0:18102:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789596985.664631:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789596986.089497:0:18152:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789596986.090428:0:18152:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789596986.315393:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596971/real 1789596971] req@ffff9c7d83e7b800 x1876527984846592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596986 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596986.316802:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d83e7b800 x1876527984846592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596986 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596986.316836:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596971/real 1789596971] req@ffff9c7d83e79500 x1876527984846720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596986 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596986.316851:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d83e79500 x1876527984846720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596986 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789596986.316874:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596986.316894:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789596986.316898:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846592:0@lo:8:kworker.0 00000100:00080000:3.0:1789596986.316903:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596986.316908:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789596986.316911:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984846720:0@lo:8:kworker.0 00000100:00080000:1.0:1789596986.317531:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596986.317536:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789596986.317539:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596986.317544:0:479:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 546 00000100:00080000:1.0:1789596986.317550:0:479:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789596986.317561:0:479:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7ebaf79800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596986.317581:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4000 x1876527984853888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596986.318643:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596986.318648:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789596986.318651:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596986.318657:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 546 00000100:00080000:1.0:1789596986.318661:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789596986.318671:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596986.318709:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d831b4e00 x1876527984854016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596986.318737:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596986.318740:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596986.318756:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596986.318759:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789596986.318797:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984853632:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.318909:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596986.318955:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984854400:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.318988:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596986.319016:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596986.319022:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984854272:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.319068:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596986.327548:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984853760:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.327740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596986.327797:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596986.327806:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984854144:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.327833:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596986.327888:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984853632 00000100:00100000:1.0:1789596986.327898:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984853632 00000100:00100000:1.0:1789596986.327957:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789596986.327967:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:3645:x1876527984853632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596986.328095:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854272 00000100:00100000:3.0:1789596986.328111:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854272 00000100:00100000:3.0:1789596986.328149:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984853760 00000100:00100000:3.0:1789596986.328153:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984853760 00000100:00100000:3.0:1789596986.328168:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789596986.328175:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984854272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596986.328544:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984854272:12345-0@lo:400:kworker.0 Request processed in 368us (9473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596986.328552:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789596986.328571:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789596986.328578:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984853760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596986.328622:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984853760:12345-0@lo:400:kworker.0 Request processed in 45us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596986.328628:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596986.330308:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:3645:x1876527984853632:12345-0@lo:400:kworker.0 Request processed in 2335us (11391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596986.330321:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789596986.330397:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854400 00000100:00100000:1.0:1789596986.330406:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854400 00000100:00100000:1.0:1789596986.331309:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854144 00000100:00100000:1.0:1789596986.331318:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854144 00000100:00100000:1.0:1789596986.331339:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596986.331362:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.332089:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984854400:12345-0@lo:400:kworker.0 Request processed in 724us (13096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596986.332400:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596986.332670:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596986.332707:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984854144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.332770:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984854144:12345-0@lo:400:kworker.0 Request processed in 93us (4936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596986.332776:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596986.332817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984853888:0@lo:8:kworker.0 00000400:00000100:1.0:1789596986.332850:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984853888 offset 0 length 520: 4 00000100:00100000:1.0:1789596986.332879:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984854016:0@lo:8:kworker.0 00000400:00000100:1.0:1789596986.332900:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984854016 offset 0 length 520: 4 00000100:00100000:1.0:1789596986.332954:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984854272:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.332967:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984853632:0@lo:400:kworker.0 00010000:00080000:1.0:1789596986.334538:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d831b4700 x1876527984854400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596986.334557:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984854400:0@lo:400:kworker.0 00010000:00080000:1.0:1789596986.335486:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d831b5500 x1876527984854144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596986.335504:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984854144:0@lo:400:kworker.0 00000100:00100000:1.0:1789596986.335524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984853760:0@lo:400:kworker.0 00010000:00010000:0.0:1789596986.689322:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789596987.645160:0:18200:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffed211b50 20000000:00000080:2.0:1789596987.645181:0:18200:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7e8743b000 uarg=0000000000000000 20000000:01000000:2.0:1789596987.645224:0:18200:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789596987.645230:0:18200:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789596987.645234:0:18200:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789596987.647922:0:18201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789596987.648063:0:18200:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789596987.657330:0:18200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789596987.657361:0:18200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.657380:0:18200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.657388:0:18200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.657395:0:18200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.657440:0:18200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.657457:0:18200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596987.657472:0:18200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18200:1876527984854528:0@lo:104: 00000100:00100000:1.0:1789596987.657543:0:18200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596987.657780:0:18200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 17 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.657790:0:18200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 17 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596987.657799:0:18200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18200:1876527984854656:0@lo:104: 00000100:00100000:1.0:1789596987.657824:0:18200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596987.661362:0:18200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789596987.664717:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854528 00000100:00100000:3.0:1789596987.664735:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854528 00000100:00100000:3.0:1789596987.664829:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854656 00000100:00100000:3.0:1789596987.664833:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854656 00000100:00100000:3.0:1789596987.664852:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596987.664862:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+4:18200:x1876527984854528:12345-0@lo:104: 00010000:00010000:3.0:1789596987.664883:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.664983:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596987.664989:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+4:18200:x1876527984854528:12345-0@lo:104: Request processed in 129us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596987.664996:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596987.665014:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596987.665020:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+3:18200:x1876527984854656:12345-0@lo:104: 00010000:00010000:3.0:1789596987.665028:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596987.665056:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596987.665080:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596987.665086:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+3:18200:x1876527984854656:12345-0@lo:104: Request processed in 66us (7261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596987.665092:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596987.665243:0:18200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18200:1876527984854528:0@lo:104: 00000100:00100000:1.0:1789596987.665254:0:18200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18200:1876527984854656:0@lo:104: 00010000:00010000:1.0:1789596987.665280:0:18200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596987.665550:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596987.665559:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789596987.665564:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596987.665573:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596987.665580:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596987.665586:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596987.665751:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665758:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596987.665790:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665796:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1400/0x7b5398e289bbfbdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfbe2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665818:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596987.665821:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665827:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596987.665830:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665837:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596987.665844:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596987.665850:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789596987.665863:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665868:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596987.665875:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665881:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511c00/0x7b5398e289bbfad8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfadf expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.665895:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596987.665896:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596987.665898:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596987.665912:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984854912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596987.665966:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596987.666006:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596987.666013:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984854784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596987.666033:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596987.666070:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854912 00000100:00100000:3.0:1789596987.666075:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854912 00010000:00010000:3.0:1789596987.666099:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 18 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596987.666128:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984854784 00000100:00100000:3.0:1789596987.666131:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984854784 00010000:00010000:3.0:1789596987.666144:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 19 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596987.666156:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596987.666163:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f66223a4-de53-4574-9339-460f93dd2c76+19:3647:x1876527984854912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596987.666174:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596987.666179:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 19 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.666189:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 19 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.666202:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81511a00/0x7b5398e289bbfadf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfad8 expref: 19 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.666214:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596987.666252:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f66223a4-de53-4574-9339-460f93dd2c76+18:3647:x1876527984854912:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596987.666259:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596987.666280:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596987.666286:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f66223a4-de53-4574-9339-460f93dd2c76+17:3647:x1876527984854784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596987.666294:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596987.666298:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596987.666372:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984854912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789596987.666430:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596987.667822:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667843:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743800/0x7b5398e289bbfbe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfbdb expref: 17 pid: 17040 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667860:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667868:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667888:0:17032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667896:0:17032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667901:0:17032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667908:0:17032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667913:0:17032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789596987.667929:0:17032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667937:0:17032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667961:0:17032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.667973:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596987.668040:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f66223a4-de53-4574-9339-460f93dd2c76+16:3647:x1876527984854784:12345-0@lo:103:ldlm_bl.0 Request processed in 1753us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596987.668048:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596987.668255:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984854784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596987.668330:0:18200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.668339:0:18200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596987.668345:0:18200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a0400/0x7b5398e289bbfc36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596987.712248:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596988.349937:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984855040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596988.350087:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.350782:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984855040 00000100:00100000:2.0:1789596988.350791:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984855040 00000100:00100000:2.0:1789596988.350846:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596988.350856:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984855040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789596988.350901:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789596988.350957:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984855040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596988.350964:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789596988.351179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984855040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596988.351198:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596988.351205:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984855168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596988.351234:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596988.351265:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984855168 00000100:00100000:1.0:1789596988.351270:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984855168 00000100:00100000:1.0:1789596988.351298:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789596988.351304:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984855168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596988.351325:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789596988.351380:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984855168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596988.351386:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789596988.351416:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984855168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596988.414274:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596978/real 1789596978] req@ffff9c7d83e78a80 x1876527984849024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596988 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596988.414309:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d83e78a80 x1876527984849024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596988 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596988.414318:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596978/real 1789596978] req@ffff9c7d83e78380 x1876527984848768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596988 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596988.414329:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d83e78380 x1876527984848768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596988 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789596988.414349:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596988.414427:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789596988.414431:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984849024:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789596988.414437:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1789596988.417422:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1789596988.417443:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596988.417448:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789596988.417451:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596988.417454:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596988.417543:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789596988.417553:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984848768:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789596988.421224:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596988.421255:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984855424:0@lo:400:kworker.0 00000100:00100000:1.0:1789596988.421346:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.421485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984855296:0@lo:400:kworker.0 00000100:00100000:2.0:1789596988.421525:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596988.421607:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984855296 00000100:00100000:1.0:1789596988.421627:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984855296 00000100:00100000:1.0:1789596988.421715:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789596988.421725:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+16:3647:x1876527984855296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596988.421783:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+16:3647:x1876527984855296:12345-0@lo:400:kworker.0 Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596988.421789:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789596988.421837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984855296:0@lo:400:kworker.0 00000100:00100000:3.0:1789596988.422025:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984855424 00000100:00100000:3.0:1789596988.422030:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984855424 00000100:00100000:3.0:1789596988.422069:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596988.422202:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984855424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596988.422257:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984855424:12345-0@lo:400:kworker.0 Request processed in 182us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596988.422264:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789596988.422342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d837b7800 x1876527984855424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596988.422356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984855424:0@lo:400:kworker.0 00000100:00080000:0.0:1789596988.424204:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596988.424211:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789596988.424230:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789596988.424238:0:479:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1789596988.424243:0:479:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789596988.424254:0:479:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb5584800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596988.424289:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b7b80 x1876527984855552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596988.424368:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984855552:0@lo:8:kworker.0 00000400:00000100:3.0:1789596988.424417:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984855552 offset 0 length 520: 4 00000100:00080000:0.0:1789596988.424473:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596988.424477:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789596988.424479:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789596988.424483:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1789596988.424486:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789596988.424491:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789596988.424506:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b5180 x1876527984855680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596988.424544:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984855680:0@lo:8:kworker.0 00000400:00000100:3.0:1789596988.424570:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984855680 offset 0 length 520: 4 00000100:00100000:1.0:1789596988.424993:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984855808:0@lo:400:kworker.0 00000100:00100000:1.0:1789596988.425031:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.425107:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984855808 00000100:00100000:2.0:1789596988.425123:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984855808 00000100:00100000:2.0:1789596988.425168:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596988.425176:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984855808:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789596988.427327:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596988.427338:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789596988.427340:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596988.427343:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789596988.428358:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984855808:12345-0@lo:400:kworker.0 Request processed in 3173us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596988.428373:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789596988.431903:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d837b7100 x1876527984855808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596988.431928:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984855808:0@lo:400:kworker.0 00010000:00010000:0.0:1789596988.738260:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596988.797597:0:17043:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596988.797606:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d8318b800 from 13 10000000:01000000:2.0:1789596988.797612:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596988.797660:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596988.797673:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596988.797709:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596988.797736:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984855936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.797807:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.797849:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596988.797921:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984855936 00000100:00100000:1.0:1789596988.797937:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984855936 00000100:00100000:1.0:1789596988.798129:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596988.798139:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+16:17043:x1876527984855936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596988.798153:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596988.798168:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc3d expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596988.798191:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596988.798202:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596988.798211:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1e00, rc 0) 00000100:00100000:1.0:1789596988.798273:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984855936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596988.798281:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789596988.798903:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984855936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596988.798922:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596988.798932:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596988.799022:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596988.799645:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596988.803433:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789596988.803502:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856064 00000100:00100000:2.0:1789596988.803514:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856064 00000100:00100000:2.0:1789596988.803569:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789596988.803578:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984856064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.803759:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984856064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596988.803766:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789596988.808882:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596988.809088:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596988.809194:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596988.809271:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596988.809713:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856192 00000100:00100000:0.0:1789596988.809722:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856192 00000100:00100000:2.0:1789596988.812003:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789596988.812020:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984856192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.813573:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984856192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1550us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596988.813594:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789596988.813758:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789596988.814638:0:18230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789596988.814947:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789596988.814976:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596988.814988:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596988.815003:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596988.815014:0:17043:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596988.815017:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebfae6000 from 13 10000000:01000000:2.0:1789596988.815020:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596988.815060:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596988.815069:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596988.815079:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596988.815104:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.815287:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.815337:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596988.815816:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856320 00000100:00100000:0.0:1789596988.815825:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856320 00000100:00100000:0.0:1789596988.815870:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789596988.815879:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+17:17043:x1876527984856320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596988.815894:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596988.815908:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc4b expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596988.815932:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596988.815944:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596988.815952:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743a00, rc 0) 00000100:00100000:0.0:1789596988.816163:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984856320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 284us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596988.816171:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789596988.817058:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596988.817079:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596988.817090:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596988.817211:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.817253:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.817287:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596988.817433:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856448 00000100:00100000:3.0:1789596988.817439:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856448 00000100:00100000:3.0:1789596988.817472:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789596988.817479:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984856448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596988.817621:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984856448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596988.817629:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789596988.817709:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.817736:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596988.817775:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596988.817799:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596988.817862:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856576 00000100:00100000:3.0:1789596988.817867:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856576 00000100:00100000:3.0:1789596988.817889:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789596988.817903:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984856576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596988.817989:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:17043:x1876527984856576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596988.817996:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789596988.818270:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984856576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789596988.819787:0:18231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789596988.821059:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789596988.821093:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596988.821104:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596988.821128:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789596989.383815:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789596989.759715:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596990.469497:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789596990.785423:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596991.807722:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596992.829459:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789596993.341948:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789596993.471151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984856704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789596993.471223:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596993.471299:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856704 00000100:00100000:1.0:1789596993.471307:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856704 00000100:00100000:1.0:1789596993.471352:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789596993.471360:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984856704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789596993.471400:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789596993.471445:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984856704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596993.471453:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789596993.471498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984856704:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789596993.473384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596993.473392:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596993.473395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596993.473398:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596993.473413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596993.473417:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596993.473420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596993.473423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789596993.473708:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984856960:0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.473781:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596993.473829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596993.474073:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984856832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.474112:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596993.474148:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984857088:0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.474174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596993.474192:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596993.474198:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984857216:0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.474234:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596993.474266:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856960 00000100:00100000:1.0:1789596993.474273:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856960 00000100:00100000:1.0:1789596993.474313:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596993.474321:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984856960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.474374:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984856960:12345-0@lo:400:kworker.0 Request processed in 54us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596993.474381:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596993.474402:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984856832 00000100:00100000:1.0:1789596993.474406:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984856832 00000100:00100000:1.0:1789596993.474427:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596993.474433:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:3647:x1876527984856832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.474464:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:3647:x1876527984856832:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596993.474470:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596993.474496:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857088 00000100:00100000:1.0:1789596993.474499:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857088 00000100:00100000:1.0:1789596993.474524:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857216 00000100:00100000:1.0:1789596993.474526:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857216 00000100:00100000:1.0:1789596993.474540:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596993.474546:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984857088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.474579:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984857088:12345-0@lo:400:kworker.0 Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596993.474585:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596993.474929:0:17047:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789596993.474939:0:17047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789596993.475543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984857344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596993.475588:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596993.475743:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596993.475755:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984857216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596993.475804:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984857216:12345-0@lo:400:kworker.0 Request processed in 53us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596993.475811:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596993.476441:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857344 00000100:00100000:1.0:1789596993.476448:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857344 00000100:00100000:1.0:1789596993.476490:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596993.476499:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984857344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789596993.476535:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789596993.476584:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984857344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596993.476742:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596993.476783:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984856832:0@lo:400:kworker.0 00000100:00100000:1.0:1789596993.476798:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984856960:0@lo:400:kworker.0 00010000:00080000:1.0:1789596993.476835:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7eb67b7b80 x1876527984857216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596993.477113:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984857344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596993.477165:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984857216:0@lo:400:kworker.0 00010000:00080000:1.0:1789596993.477180:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7eb67b5c00 x1876527984857088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596993.477189:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984857088:0@lo:400:kworker.0 00010000:00010000:0.0:1789596993.858568:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596994.877672:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789596995.788482:0:18550:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789596995.788487:0:18550:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789596995.788489:0:18550:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789596995.788620:0:18550:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7eb75f4800 00000020:01000004:2.0:1789596995.788647:0:18550:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789596995.788662:0:18550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789596995.788721:0:18550:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c7eb98bcd40) 00000020:00000080:2.0:1789596995.788739:0:18550:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789596995.872735:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789596995.887462:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789596995.889373:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789596995.891009:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789596995.892309:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789596995.892969:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789596995.894236:0:18550:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1789596995.900240:0:18550:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789596995.900524:0:18550:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789596995.900542:0:18550:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789596995.900558:0:18550:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7b5398e289bbfc60 00000020:01000004:3.0:1789596995.900567:0:18550:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789596995.900608:0:18550:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789596995.900611:0:18550:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789596995.900637:0:18550:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789596995.900643:0:18550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789596995.900667:0:18550:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c7eb76ccd40) 00000020:00000080:3.0:1789596995.900744:0:18550:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789596995.901998:0:18550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596995.902188:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789596995.902195:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00010000:00010000:1.0:1789596995.909213:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596995.912941:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789596995.912957:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789596995.916291:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596995.916307:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789596995.920033:0:18550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596995.920353:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789596995.920359:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789596995.921459:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789596995.921470:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789596995.986011:0:18550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596995.986340:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789596995.986347:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789596995.994532:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789596995.994555:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789596996.001101:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596996.001117:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789596996.003265:0:18550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596996.003495:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789596996.003504:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789596996.009574:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789596996.009592:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789596996.108652:0:18550:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596996.108937:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789596996.108945:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789596996.110942:0:18550:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789596996.110960:0:18550:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789596996.128452:0:18550:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789596996.130346:0:18550:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789596996.130358:0:18550:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789596996.181636:0:18550:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596996.181781:0:18550:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789596996.181787:0:18550:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596996.181789:0:18550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789596996.181790:0:18550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596996.181791:0:18550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596996.181792:0:18550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596996.181794:0:18550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596996.181795:0:18550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596996.181797:0:18550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596996.181799:0:18550:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596996.181819:0:18550:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789596996.181823:0:18550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596996.181824:0:18550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789596996.181825:0:18550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596996.181826:0:18550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596996.181827:0:18550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596996.181829:0:18550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596996.181830:0:18550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596996.181831:0:18550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596996.181832:0:18550:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596996.182349:0:18550:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789596996.182379:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789596996.182480:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596996.182643:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596996.193434:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857472 00000100:00100000:3.0:1789596996.193452:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857472 00000100:00100000:3.0:1789596996.193579:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789596996.193591:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:18550:x1876527984857472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789596996.193633:0:17041:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789596996.193637:0:17041:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789596996.193641:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789596996.199356:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:18550:x1876527984857472:12345-0@lo:253:mount.lustre.0 Request processed in 5758us (16866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.199371:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596996.199490:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789596996.199505:0:18550:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789596996.199508:0:18550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789596996.199510:0:18550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789596996.199511:0:18550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596996.199512:0:18550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596996.199514:0:18550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596996.199516:0:18550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596996.199517:0:18550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596996.199534:0:18550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596996.199535:0:18550:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789596996.199558:0:18550:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7eb75f4800 from lustre-OST0000 10000000:01000000:0.0:1789596996.199601:0:18550:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789596996.199605:0:18550:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789596996.199613:0:18550:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7d83514d40 local copy 00010000:00010000:0.0:1789596996.199625:0:18550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596996.199778:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596996.199833:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596996.216119:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596996.221785:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857600 00000100:00100000:1.0:1789596996.221806:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857600 00000100:00100000:0.0:1789596996.222325:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596996.222338:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:18550:x1876527984857600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596996.222515:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+18:18550:x1876527984857600:12345-0@lo:501:mount.lustre.0 Request processed in 179us (22680us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596996.222523:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789596996.224222:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857600:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789596996.224250:0:18550:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789596996.224296:0:18550:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789596996.224306:0:18550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.224318:0:18550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596996.224372:0:18550:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7eb75f4800 10000000:01000000:1.0:1789596996.224377:0:18550:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789596996.224383:0:18550:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789596996.224386:0:18550:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789596996.224392:0:18550:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789596996.224395:0:18550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789596996.224434:0:18550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.224442:0:18550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.224453:0:18550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596996.224477:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596996.224544:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596996.225125:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596996.225416:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857728 00000100:00100000:3.0:1789596996.225424:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857728 00000100:00100000:3.0:1789596996.225479:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596996.225489:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+18:18550:x1876527984857728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596996.225529:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596996.225545:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bbfc75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc6e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.226079:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bbfc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc6e expref: 19 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.226094:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bbfc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc6e expref: 19 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.226105:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80030a00, rc 0) 00000100:00100000:3.0:1789596996.226170:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984857728:12345-0@lo:101:mount.lustre.0 Request processed in 682us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.226177:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789596996.226491:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596996.226513:0:18550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.226524:0:18550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596996.230326:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789596996.231359:0:18550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596996.235645:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789596996.235749:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789596996.235764:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789596996.235776:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789596996.235790:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789596996.235804:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789596996.235830:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789596996.235835:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789596996.238336:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596996.238422:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596996.238502:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789596996.238556:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857856 00000100:00100000:3.0:1789596996.238632:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857856 00000100:00100000:3.0:1789596996.238824:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789596996.238835:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984857856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596996.239032:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984857856:12345-0@lo:501:mount.lustre.0 Request processed in 200us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.239077:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789596996.239147:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596996.239183:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596996.239228:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596996.239361:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.239432:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984857984 00000100:00100000:0.0:1789596996.239436:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984857984 00000100:00100000:0.0:1789596996.239461:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596996.239467:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984857984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596996.240372:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984857984:12345-0@lo:503:mount.lustre.0 Request processed in 900us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.240381:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789596996.240504:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984857984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789596996.241284:0:18550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596996.241388:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596996.241453:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596996.241546:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596996.241654:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858112 00000100:00100000:3.0:1789596996.241661:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858112 00000100:00100000:2.0:1789596996.241850:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596996.241860:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984858112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596996.242658:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984858112:12345-0@lo:502:mount.lustre.0 Request processed in 795us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596996.242667:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789596996.243067:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596996.243325:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789596996.243356:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789596996.243371:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789596996.243385:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789596996.243397:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789596996.243409:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789596996.243425:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789596996.243448:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789596996.243462:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789596996.243475:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789596996.243486:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789596996.243498:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789596996.243541:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596996.243759:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596996.243862:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858240 00000100:00100000:2.0:1789596996.243870:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858240 00000100:00100000:2.0:1789596996.244019:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789596996.244028:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984858240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596996.244131:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984858240:12345-0@lo:502:mount.lustre.0 Request processed in 105us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596996.244138:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789596996.244237:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596996.244260:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789596996.244308:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789596996.244317:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789596996.247532:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789596996.247552:0:18567:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789596996.247560:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596996.247562:0:18567:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789596996.249087:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789596996.249105:0:18567:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c7e9e35b380) 00000020:00000080:0.0:1789596996.249136:0:18567:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789596996.249142:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789596996.249255:0:18567:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7eb75f4800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789596996.249266:0:18567:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789596996.249273:0:18567:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7b5398e289bbfc83 00010000:00010000:0.0:1789596996.253368:0:18567:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789596996.255071:0:18567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789596996.258265:0:18567:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789596996.268405:0:18567:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789596996.268419:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.268427:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.268430:0:18567:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789596996.268433:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789596996.268437:0:18567:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789596996.268438:0:18567:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596996.268440:0:18567:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596996.268442:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789596996.268444:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.268446:0:18567:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789596996.268448:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596996.268451:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.268453:0:18567:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789596996.268456:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789596996.268458:0:18567:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789596996.268460:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.268462:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.268463:0:18567:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789596996.268483:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596996.268486:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.268487:0:18567:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789596996.268490:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789596996.268523:0:18567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.268526:0:18567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.268528:0:18567:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789596996.268532:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789596996.272724:0:18550:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789596996.272776:0:18550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789596996.272803:0:18550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.272831:0:18550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596996.272840:0:18550:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb75f4800 from 1 10000000:01000000:3.0:1789596996.272842:0:18550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596996.272884:0:18550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.272892:0:18550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.272905:0:18550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596996.272932:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596996.273010:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.273058:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004180 going to sleep for 11 seconds 00000100:00100000:2.0:1789596996.273343:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858368 00000100:00100000:2.0:1789596996.273352:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858368 00000100:00100000:2.0:1789596996.273397:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789596996.273405:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:18550:x1876527984858368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596996.273420:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596996.273433:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc8a expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.273460:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 20 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.273471:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 20 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.273479:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd400, rc 0) 00000100:00100000:2.0:1789596996.273521:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858368:12345-0@lo:101:mount.lustre.0 Request processed in 116us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596996.273540:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789596996.277174:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596996.277217:0:18550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.277230:0:18550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596996.278428:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789596996.279468:0:18550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596996.284463:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789596996.284539:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789596996.284579:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789596996.284586:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789596996.284738:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596996.285106:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.285160:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.285329:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858496 00000100:00100000:0.0:1789596996.285339:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858496 00000100:00100000:0.0:1789596996.285396:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789596996.285408:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596996.285553:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858496:12345-0@lo:501:mount.lustre.0 Request processed in 149us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.285574:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596996.285873:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596996.285913:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596996.285964:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.285994:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.286159:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858624 00000100:00100000:0.0:1789596996.286164:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858624 00000100:00100000:0.0:1789596996.286200:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789596996.286208:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596996.286292:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858624:12345-0@lo:503:mount.lustre.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.286300:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789596996.286429:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858624:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789596996.286927:0:18550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596996.287007:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596996.287068:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.287086:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.287325:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858752 00000100:00100000:0.0:1789596996.287331:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858752 00000100:00100000:0.0:1789596996.287380:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789596996.287388:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596996.287479:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858752:12345-0@lo:502:mount.lustre.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.287486:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596996.291176:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596996.291503:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789596996.291544:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789596996.291559:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789596996.291726:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789596996.291743:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789596996.291757:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789596996.291770:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789596996.291783:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789596996.291796:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789596996.291999:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789596996.292054:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789596996.292108:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596996.292204:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.292356:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.293249:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984858880 00000100:00100000:0.0:1789596996.293261:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984858880 00000100:00100000:0.0:1789596996.293318:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789596996.293328:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596996.293474:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984858880:12345-0@lo:502:mount.lustre.0 Request processed in 147us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.293483:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596996.293707:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984858880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596996.293776:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789596996.293789:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789596996.301125:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596996.301138:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301141:0:18571:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789596996.301149:0:18571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7eb75f4800 00000020:00000080:1.0:1789596996.301152:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596996.301160:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.301162:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301163:0:18571:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789596996.301166:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596996.301168:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301170:0:18571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789596996.301173:0:18571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7eb75f4800 00000020:00000080:1.0:1789596996.301175:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596996.301250:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.301254:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301255:0:18571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789596996.301258:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596996.301261:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301262:0:18571:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596996.301265:0:18571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7eb75f4800 00000020:00000080:1.0:1789596996.301267:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596996.301284:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.301287:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301288:0:18571:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596996.301291:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596996.301293:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301300:0:18571:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789596996.301304:0:18571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7eb75f4800 00000020:00000080:1.0:1789596996.301306:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596996.301329:0:18571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596996.301332:0:18571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596996.301333:0:18571:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789596996.301336:0:18571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789596996.301463:0:18550:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789596996.301497:0:18550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596996.301522:0:18550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.301535:0:18550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596996.301596:0:18550:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789596996.301599:0:18550:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7eb75f4800 10000000:01000000:3.0:1789596996.301603:0:18550:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7eb75f4800 10000000:01000000:3.0:1789596996.301607:0:18550:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596996.301613:0:18550:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7eb75f4800 from 1 10000000:01000000:3.0:1789596996.301616:0:18550:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789596996.301662:0:18550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.301671:0:18550:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.301722:0:18550:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596996.301750:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596996.301820:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.301861:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596996.302031:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859008 00000100:00100000:1.0:1789596996.302046:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859008 00000100:00100000:1.0:1789596996.302086:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789596996.302096:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+20:18550:x1876527984859008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596996.302109:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596996.302123:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bbfc9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfc98 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.302146:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bbfc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfc98 expref: 21 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.302157:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bbfc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc98 expref: 21 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596996.302165:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1200, rc 0) 00000100:00100000:1.0:1789596996.302213:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859008:12345-0@lo:101:mount.lustre.0 Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596996.302220:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789596996.302665:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596996.302719:0:18550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.302730:0:18550:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596996.303899:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789596996.304191:0:18550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596996.304358:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789596996.304380:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789596996.304393:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789596996.304404:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789596996.304417:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789596996.304427:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789596996.304436:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789596996.304446:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789596996.304457:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789596996.304478:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789596996.304490:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789596996.304503:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789596996.304530:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789596996.304545:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789596996.304557:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789596996.306664:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789596996.306767:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789596996.306782:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789596996.306794:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789596996.306807:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789596996.306832:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789596996.306845:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789596996.306857:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789596996.306870:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789596996.306883:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789596996.306897:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789596996.306910:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789596996.306924:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789596996.306955:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789596996.306968:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789596996.306981:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789596996.306994:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789596996.307004:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789596996.307016:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789596996.307029:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789596996.307051:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789596996.307064:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789596996.307092:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789596996.307097:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789596996.307238:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596996.307310:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.309976:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596996.313882:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859136 00000100:00100000:1.0:1789596996.313897:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859136 00000100:00100000:0.0:1789596996.314029:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789596996.314050:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596996.314253:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859136:12345-0@lo:501:mount.lustre.0 Request processed in 215us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.314261:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789596996.318460:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596996.318518:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596996.318588:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.329427:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.329515:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859264 00000100:00100000:0.0:1789596996.329526:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859264 00000100:00100000:0.0:1789596996.329652:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789596996.329664:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596996.329842:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859264:12345-0@lo:503:mount.lustre.0 Request processed in 180us (11255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.329851:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789596996.330744:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789596996.331250:0:18550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596996.331337:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596996.331401:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.331423:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596996.331867:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859392 00000100:00100000:1.0:1789596996.331874:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859392 00000100:00100000:1.0:1789596996.331921:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789596996.331930:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596996.332064:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859392:12345-0@lo:502:mount.lustre.0 Request processed in 135us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596996.332072:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789596996.332199:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596996.332398:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789596996.332425:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789596996.332438:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789596996.332465:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789596996.332479:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789596996.332492:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789596996.332503:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789596996.332515:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789596996.332526:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789596996.332538:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789596996.332550:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789596996.333730:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789596996.333781:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789596996.333803:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789596996.333816:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789596996.333828:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789596996.334649:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789596996.334719:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789596996.334736:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789596996.334764:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789596996.334779:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789596996.334792:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789596996.334806:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789596996.334823:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789596996.334836:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789596996.335017:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789596996.335031:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789596996.335057:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789596996.335071:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789596996.335084:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789596996.335097:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789596996.335109:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789596996.335122:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789596996.335135:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789596996.335147:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789596996.335172:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789596996.335187:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789596996.335200:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789596996.335211:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789596996.335223:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789596996.335236:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789596996.335250:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789596996.335263:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789596996.335275:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789596996.335288:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789596996.335299:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789596996.335311:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789596996.335324:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789596996.335385:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596996.335473:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.337237:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596996.341290:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859520 00000100:00100000:1.0:1789596996.341306:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859520 00000100:00100000:1.0:1789596996.341360:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789596996.341370:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596996.341592:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859520:12345-0@lo:502:mount.lustre.0 Request processed in 223us (6118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596996.341601:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789596996.343145:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596996.343365:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789596996.343391:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789596996.343439:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596996.343507:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.344162:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d830049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596996.346249:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859648 00000100:00100000:1.0:1789596996.346265:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859648 00000100:00100000:1.0:1789596996.346387:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596996.346398:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596996.346548:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984859648:12345-0@lo:502:mount.lustre.0 Request processed in 152us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596996.346556:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789596996.346789:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984859648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596996.347008:0:18550:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789596996.347021:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789596996.347926:0:18576:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789596996.347943:0:18576:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c7ebbcb19c0) 00000020:00000080:1.0:1789596996.347968:0:18576:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789596996.348056:0:18576:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7eb75f4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789596996.348061:0:18576:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7eb75f4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789596996.348064:0:18576:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb75f4800 3 00010000:00080000:1.0:1789596996.348095:0:18576:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7ea03c2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789596996.350335:0:18576:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789596996.350659:0:18576:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789596996.350739:0:18576:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789596996.350759:0:18576:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7b5398e289bbfcad 00000100:00080000:1.0:1789596996.350772:0:18576:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596996.350784:0:18576:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7ea03c2000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596996.350958:0:18576:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb67b5c00 x1876527984859776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596996.350989:0:18576:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789596996.351354:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984859776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789596996.351424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596996.351538:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859776 00000100:00100000:0.0:1789596996.351547:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859776 00000100:00100000:0.0:1789596996.351657:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596996.351665:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984859776:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789596996.351724:0:17047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1789596996.351771:0:17047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7b5398e289bbfcb4 00000004:00100000:0.0:1789596996.351787:0:17047:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789596996.351832:0:17047:0:(import.c:65:import_set_state_nolock()) ffff9c7d83ee0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596996.351886:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876527984859776:12345-0@lo:38:llog_process_th.0 Request processed in 220us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.351893:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789596996.351937:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7eb67b5c00 x1876527984859776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596996.351947:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596996.351955:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789596996.351964:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789596996.351968:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789596996.351970:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ea03c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596996.351976:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984859776:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789596996.353067:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.353073:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596996.353076:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.353080:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596996.353110:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.353114:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596996.353116:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.353120:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789596996.353170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984860032:0@lo:400:kworker.0 00000100:00100000:3.0:1789596996.353225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.353254:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596996.353261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984860160:0@lo:400:kworker.0 00000100:00100000:3.0:1789596996.353298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.353333:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860032 00000100:00100000:3.0:1789596996.353339:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860032 00000100:00100000:3.0:1789596996.353378:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596996.353386:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984860032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596996.353431:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984860032:12345-0@lo:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.353438:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596996.353460:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860160 00000100:00100000:3.0:1789596996.353463:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860160 00000100:00100000:3.0:1789596996.353483:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789596996.353488:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984860160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596996.353529:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984860160:12345-0@lo:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.353536:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596996.353693:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984860288:0@lo:400:kworker.0 00000100:00100000:2.0:1789596996.353721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596996.353741:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596996.353747:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984859904:0@lo:400:kworker.0 00000100:00100000:2.0:1789596996.353767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596996.353961:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984859904 00000100:00100000:0.0:1789596996.353966:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984859904 00000100:00100000:0.0:1789596996.354061:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596996.354069:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984859904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596996.354109:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984859904:12345-0@lo:400:kworker.0 Request processed in 41us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.354116:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596996.354160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984859904:0@lo:400:kworker.0 00000100:00100000:0.0:1789596996.354191:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860288 00000100:00100000:0.0:1789596996.354195:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860288 00000100:00100000:0.0:1789596996.354217:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596996.354223:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984860288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596996.354253:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984860288:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.354259:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789596996.354285:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d825f4e00 x1876527984860288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596996.354297:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984860288:0@lo:400:kworker.0 00000100:00100000:3.0:1789596996.354458:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984860160:0@lo:400:kworker.0 00010000:00080000:3.0:1789596996.354474:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7d825f5880 x1876527984860032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596996.354483:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984860032:0@lo:400:kworker.0 00000020:01000004:1.0:1789596996.355327:0:18576:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789596996.355343:0:18576:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c7ebbcb4d40) 00000020:00000080:1.0:1789596996.355364:0:18576:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789596996.355462:0:18576:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7eb75f4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789596996.355466:0:18576:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7eb75f4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789596996.355469:0:18576:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb75f4800 3 00010000:00080000:1.0:1789596996.355506:0:18576:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d831a0000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789596996.358269:0:18576:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789596996.364266:0:18576:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789596996.364319:0:18576:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789596996.364332:0:18576:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7b5398e289bbfcc2 00000100:00080000:1.0:1789596996.364344:0:18576:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596996.364356:0:18576:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c7d831a0000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789596996.364400:0:18576:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb67b7b80 x1876527984860416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596996.364433:0:18576:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789596996.364639:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984860416:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596996.364736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596996.364837:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860416 00000100:00100000:2.0:1789596996.364845:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860416 00000100:00100000:2.0:1789596996.364883:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596996.364890:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984860416:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789596996.364914:0:17048:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1789596996.364961:0:17048:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7b5398e289bbfcc9 00000004:00100000:2.0:1789596996.364976:0:17048:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789596996.365004:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c8d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596996.365067:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876527984860416:12345-0@lo:38:llog_process_th.0 Request processed in 176us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596996.365075:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789596996.366429:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7eb67b7b80 x1876527984860416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596996.366443:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596996.366452:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789596996.366460:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789596996.366464:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789596996.366467:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d831a0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789596996.366473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984860416:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789596996.377429:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.377438:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596996.377441:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.377444:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596996.377448:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.377457:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789596996.377460:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596996.377463:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789596996.387018:0:18576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789596996.387504:0:18550:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789596996.387538:0:18550:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596996.387730:0:18550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.387744:0:18550:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596996.387802:0:18550:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596996.387804:0:18550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596996.387806:0:18550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596996.387807:0:18550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596996.387818:0:18550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596996.387820:0:18550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596996.387822:0:18550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596996.387824:0:18550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596996.387826:0:18550:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596996.387830:0:18550:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789596996.387833:0:18550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596996.387834:0:18550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596996.387836:0:18550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596996.387837:0:18550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596996.387838:0:18550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596996.387840:0:18550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596996.387841:0:18550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596996.387842:0:18550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596996.387843:0:18550:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596996.387883:0:18550:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789596996.387903:0:18550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984860544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596996.387979:0:18550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.388026:0:18550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596996.389784:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860544 00000100:00100000:0.0:1789596996.389797:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860544 00000100:00100000:0.0:1789596996.391182:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789596996.391197:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:18550:x1876527984860544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789596996.391243:0:17040:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789596996.391256:0:17040:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789596996.397504:0:17040:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789596996.397524:0:17040:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789596996.397617:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789596996.397623:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789596996.397646:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.397666:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 21 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.397675:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.397714:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.397753:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.397767:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 21 pid: 17039 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596996.397781:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984860672:0@lo:104: 00000100:00100000:3.0:1789596996.397994:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596996.398057:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 21 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.398066:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 21 pid: 17040 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596996.398075:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984860800:0@lo:104: 00000100:00100000:3.0:1789596996.398099:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596996.398126:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83004f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596996.398152:0:17029:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789596996.398170:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860672 00000100:00100000:3.0:1789596996.398177:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860672 00000100:00100000:3.0:1789596996.398212:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860800 00000100:00100000:3.0:1789596996.398215:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860800 00000100:00100000:3.0:1789596996.398229:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596996.398238:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+4:17063:x1876527984860672:12345-0@lo:104: 00010000:00010000:3.0:1789596996.398252:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.398301:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596996.398307:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+4:17063:x1876527984860672:12345-0@lo:104: Request processed in 70us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.398314:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596996.398330:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596996.398335:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4618050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984860800:12345-0@lo:104: 00010000:00010000:3.0:1789596996.398342:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.398372:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789596996.398377:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4618050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984860800:12345-0@lo:104: Request processed in 42us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596996.398383:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596996.398435:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984860672:0@lo:104: 00000100:00100000:3.0:1789596996.398443:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984860800:0@lo:104: 00010000:00010000:3.0:1789596996.398459:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.398999:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596996.399007:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399016:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596996.399020:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399030:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596996.399380:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596996.399389:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596996.399425:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399432:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596996.399458:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399466:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bbfc21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc28 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399481:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596996.399485:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399504:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789596996.399507:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399515:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596996.399522:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596996.399527:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789596996.399539:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399544:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596996.399558:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399565:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfc13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc1a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.399581:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596996.399583:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596996.399585:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596996.399601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984861056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596996.399651:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596996.400270:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984860928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596996.400376:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596996.400433:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861056 00000100:00100000:0.0:1789596996.400440:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861056 00010000:00010000:0.0:1789596996.400466:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 22 pid: 17040 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596996.400488:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984860928 00000100:00100000:0.0:1789596996.400490:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984860928 00010000:00010000:0.0:1789596996.400500:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 23 pid: 17039 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596996.400512:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596996.400519:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+23:3644:x1876527984861056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789596996.400530:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596996.400535:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 23 pid: 17040 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596996.400546:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 23 pid: 17040 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.400667:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596996.400696:0:17033:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789596996.400704:0:17033:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789596996.400863:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:18550:x1876527984860544:12345-0@lo:253:mount.lustre.0 Request processed in 9669us (12882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596996.400885:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789596996.401181:0:18550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:18550:1876527984860544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789596996.401193:0:18550:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789596996.401203:0:18550:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596996.401204:0:18550:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596996.401205:0:18550:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596996.401206:0:18550:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596996.401207:0:18550:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596996.401209:0:18550:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596996.401211:0:18550:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596996.401212:0:18550:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596996.401213:0:18550:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789596996.401227:0:18550:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789596996.402166:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596996.402182:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+22:3647:x1876527984860928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596996.402202:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596996.402212:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 22 pid: 17039 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402228:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 22 pid: 17039 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402247:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfc28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfc21 expref: 22 pid: 17039 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402267:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402276:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596996.402292:0:17033:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007435860s 00010000:00010000:2.0:1789596996.402297:0:17033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402304:0:17033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402312:0:17033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402319:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402332:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789596996.402337:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402345:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402362:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596996.402373:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596996.402447:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+21:3647:x1876527984860928:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596996.402454:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789596996.403966:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfc1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfc13 expref: 23 pid: 17040 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596996.403998:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596996.404112:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+19:3644:x1876527984861056:12345-0@lo:103:ldlm_bl.0 Request processed in 3588us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596996.404135:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596996.404235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984860928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596996.408034:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984861056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596996.412245:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.412265:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596996.412274:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030000/0x7b5398e289bbfcd0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789596996.417525:0:18550:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789596996.433526:0:18550:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789596996.433536:0:18550:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789596996.433800:0:18550:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789596996.433958:0:18550:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789596996.433981:0:18550:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789596996.434087:0:18550:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789596996.435339:0:18550:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789596996.435582:0:18550:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789596996.925968:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789596997.656505:0:18632:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789596997.657046:0:18632:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789596997.957037:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596998.208043:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596998.208053:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d8318b800 from 9 10000000:01000000:2.0:1789596998.208059:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596998.208110:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.208123:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.208155:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596998.208183:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596998.208260:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596998.208311:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596998.208491:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861184 00000100:00100000:1.0:1789596998.208501:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861184 00000100:00100000:0.0:1789596998.208638:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789596998.208652:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+19:17043:x1876527984861184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596998.208667:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596998.208718:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfcd7 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596998.208748:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 20 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596998.208760:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 20 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596998.208769:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789596998.208823:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+20:17043:x1876527984861184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596998.208830:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789596998.209056:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596998.209071:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.209080:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596998.209133:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789596998.209163:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596998.209185:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596998.209258:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861312 00000100:00100000:1.0:1789596998.209263:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861312 00000100:00100000:1.0:1789596998.209293:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789596998.209300:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+20:17043:x1876527984861312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789596998.209325:0:17039:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789596998.209341:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789596998.209345:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789596998.209420:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+20:17043:x1876527984861312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596998.209428:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789596998.210009:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789596998.210090:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596998.210098:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.210109:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596998.210121:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596998.210124:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7ebfae6000 from 9 10000000:01000000:2.0:1789596998.210133:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596998.210156:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.210164:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.210174:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596998.210189:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596998.210224:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596998.210259:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596998.210275:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861440 00000100:00100000:2.0:1789596998.210279:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861440 00000100:00100000:2.0:1789596998.210304:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789596998.210311:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+20:17043:x1876527984861440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596998.210322:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596998.210333:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfce5 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.210352:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.210362:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596998.210371:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dca00, rc 0) 00000100:00100000:2.0:1789596998.210407:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984861440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596998.210422:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596998.210503:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596998.210515:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596998.210524:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596998.210590:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789596998.210627:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596998.210647:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1789596998.211739:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861568 00000100:00100000:2.0:1789596998.211749:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861568 00000100:00100000:2.0:1789596998.211790:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789596998.211809:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984861568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789596998.211833:0:17041:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789596998.211853:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789596998.211857:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789596998.211954:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984861568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596998.211963:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789596998.212153:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984861568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789596998.212217:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789596998.212226:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596998.212238:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596998.591609:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984861696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789596998.591718:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596998.592591:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861696 00000100:00100000:0.0:1789596998.592607:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861696 00000100:00100000:0.0:1789596998.592675:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596998.592716:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984861696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789596998.592763:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789596998.593125:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984861696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 411us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596998.593132:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596998.593191:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984861696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789596998.593746:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596998.593771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984861824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789596998.594531:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596998.594963:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861824 00000100:00100000:3.0:1789596998.594974:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861824 00000100:00100000:3.0:1789596998.595595:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596998.595607:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984861824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789596998.595648:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789596998.595745:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984861824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596998.595759:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596998.600335:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984861824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789596998.972949:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596999.997029:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789597000.701812:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789597001.022261:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789597001.668817:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597001.668826:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789597001.668830:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597001.668834:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789597001.668849:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597001.668852:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789597001.668856:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597001.668859:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789597001.668924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984862208:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669090:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984862720:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669118:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669144:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789597001.669150:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984862080:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669172:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669195:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984862592:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669214:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669239:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984862336:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669261:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669278:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789597001.669283:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984861952:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669309:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669330:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984862464:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669348:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597001.669374:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862208 00000100:00100000:2.0:1789597001.669383:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862208 00000100:00100000:2.0:1789597001.669431:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862720 00000100:00100000:2.0:1789597001.669434:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862720 00000100:00100000:2.0:1789597001.669456:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862592 00000100:00100000:2.0:1789597001.669458:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862592 00000100:00100000:2.0:1789597001.669473:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862464 00000100:00100000:2.0:1789597001.669476:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862464 00000100:00100000:2.0:1789597001.669490:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789597001.669497:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984862208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.669557:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984862208:12345-0@lo:400:kworker.0 Request processed in 59us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.669576:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789597001.669595:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789597001.669602:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984862720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670110:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984862720:12345-0@lo:400:kworker.0 Request processed in 508us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.670118:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789597001.670136:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789597001.670143:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984862592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670172:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984862592:12345-0@lo:400:kworker.0 Request processed in 30us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.670178:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789597001.670189:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597001.670194:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984862464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670236:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984862464:12345-0@lo:400:kworker.0 Request processed in 41us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.670241:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597001.670262:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984861952 00000100:00100000:2.0:1789597001.670266:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984861952 00000100:00100000:2.0:1789597001.670297:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789597001.670303:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:3646:x1876527984861952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670331:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:3646:x1876527984861952:12345-0@lo:400:kworker.0 Request processed in 29us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.670337:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789597001.670384:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83e79880 x1876527984862592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597001.670417:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984862592:0@lo:400:kworker.0 00010000:00080000:2.0:1789597001.670432:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83e79500 x1876527984862208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597001.670440:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984862208:0@lo:400:kworker.0 00010000:00080000:2.0:1789597001.670450:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83e78000 x1876527984862720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597001.670456:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984862720:0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670513:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862080 00000100:00100000:2.0:1789597001.670518:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862080 00000100:00100000:2.0:1789597001.670540:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862336 00000100:00100000:2.0:1789597001.670542:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862336 00000100:00100000:2.0:1789597001.670555:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597001.670561:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984862080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670598:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984862080:12345-0@lo:400:kworker.0 Request processed in 38us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.670605:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597001.670616:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789597001.670622:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984862336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597001.670648:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984862336:12345-0@lo:400:kworker.0 Request processed in 27us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597001.670653:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789597001.670714:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984862080:0@lo:400:kworker.0 00000100:00080000:2.0:1789597001.670768:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597001.670779:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789597001.670934:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984861952:0@lo:400:kworker.0 00010000:00080000:3.0:1789597001.670948:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83e78700 x1876527984862464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597001.670957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984862464:0@lo:400:kworker.0 00000100:00100000:3.0:1789597001.670967:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984862336:0@lo:400:kworker.0 00010000:00010000:2.0:1789597002.049756:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597003.070563:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597003.522103:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596988/real 1789596988] req@ffff9c7d837b5180 x1876527984855680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597003.522147:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d837b5180 x1876527984855680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597003.522157:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596988/real 1789596988] req@ffff9c7d837b7b80 x1876527984855552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597003.522168:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d837b7b80 x1876527984855552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789597003.522187:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597003.522220:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789597003.522224:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984855680:0@lo:8:kworker.0 00000100:00080000:1.0:1789597003.522230:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597003.522236:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789597003.522239:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984855552:0@lo:8:kworker.0 00000100:00080000:3.0:1789597003.527131:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597003.527139:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789597003.527142:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597003.527145:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789597003.527171:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597003.527174:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789597003.527179:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597003.527189:0:479:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 563 00000100:00080000:3.0:1789597003.527196:0:479:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789597003.527209:0:479:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb5584800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597003.527235:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb98d5c00 x1876527984863360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597003.527254:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597003.527258:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789597003.527260:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597003.527263:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 563 00000100:00080000:3.0:1789597003.527274:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789597003.527280:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597003.527292:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb98d4000 x1876527984863488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597003.527345:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984862976:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527472:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984863744:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527528:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789597003.527534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984862848:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527565:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527586:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984863616:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527608:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527635:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984863104:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527671:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984863872:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527723:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527740:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789597003.527745:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984863232:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.527763:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984863360:0@lo:8:kworker.0 00000100:00100000:3.0:1789597003.527815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.527928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984863488:0@lo:8:kworker.0 00000100:00100000:3.0:1789597003.527956:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.528011:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862976 00000100:00100000:3.0:1789597003.528021:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862976 00000100:00100000:3.0:1789597003.528075:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863232 00000100:00100000:3.0:1789597003.528078:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863232 00000100:00100000:3.0:1789597003.528095:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789597003.528105:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984862976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528166:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984862976:12345-0@lo:400:kworker.0 Request processed in 61us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528173:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789597003.528194:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789597003.528199:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984863232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528228:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984863232:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528234:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789597003.528250:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863744 00000100:00100000:3.0:1789597003.528254:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863744 00000100:00100000:3.0:1789597003.528287:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863616 00000100:00100000:3.0:1789597003.528290:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863616 00000100:00100000:3.0:1789597003.528299:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863104 00000100:00100000:3.0:1789597003.528302:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863104 00000100:00100000:3.0:1789597003.528311:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863872 00000100:00100000:3.0:1789597003.528313:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863872 00000100:00100000:3.0:1789597003.528328:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789597003.528334:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984863744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528363:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984863744:12345-0@lo:400:kworker.0 Request processed in 30us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528370:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789597003.528380:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597003.528385:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984863616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528419:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984863616:12345-0@lo:400:kworker.0 Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528426:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597003.528437:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789597003.528442:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984863104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528467:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984863104:12345-0@lo:400:kworker.0 Request processed in 25us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528473:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789597003.528482:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789597003.528487:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984863872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528509:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984863872:12345-0@lo:400:kworker.0 Request processed in 22us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528514:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789597003.528532:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984862848 00000100:00100000:3.0:1789597003.528537:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984862848 00000100:00100000:3.0:1789597003.528564:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789597003.528569:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:3647:x1876527984862848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.528599:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:3647:x1876527984862848:12345-0@lo:400:kworker.0 Request processed in 29us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.528604:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789597003.528655:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863360 00000100:00100000:3.0:1789597003.528659:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863360 00000100:00100000:3.0:1789597003.528673:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984863488 00000100:00100000:3.0:1789597003.528716:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984863488 00000100:00100000:3.0:1789597003.528730:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789597003.528735:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984863360:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789597003.528775:0:18554:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:3.0:1789597003.528810:0:18554:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfcf3 00002000:00100000:3.0:1789597003.528824:0:18554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c7e9e291800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789597003.528828:0:18554:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789597003.528831:0:18554:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789597003.529055:0:18554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789597003.529086:0:18554:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e293800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597003.529130:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984863360:12345-0@lo:8:kworker.0 Request processed in 394us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.529136:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789597003.529149:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789597003.529153:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984863488:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789597003.529166:0:18554:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789597003.532960:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984862848:0@lo:400:kworker.0 00010000:00080000:0.0:1789597003.532998:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d4a80 x1876527984863616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597003.533010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984863616:0@lo:400:kworker.0 00000100:00100000:0.0:1789597003.533044:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984862976:0@lo:400:kworker.0 00010000:00080000:0.0:1789597003.533059:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d6a00 x1876527984863744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597003.533068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984863744:0@lo:400:kworker.0 00000100:00100000:3.0:1789597003.536174:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984863232:0@lo:400:kworker.0 00010000:00080000:3.0:1789597003.536196:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d5180 x1876527984863104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597003.536206:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984863104:0@lo:400:kworker.0 00010000:00080000:3.0:1789597003.536217:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d5500 x1876527984863872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597003.536225:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984863872:0@lo:400:kworker.0 00000100:00080000:3.0:1789597003.536260:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789597003.536265:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789597003.536305:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d5c00 x1876527984863360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597003.536337:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597003.536347:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789597003.536357:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789597003.536363:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789597003.536367:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789597003.536436:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789597003.536442:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984863360:0@lo:8:kworker.0 00000100:00100000:3.0:1789597003.536540:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984863488:12345-0@lo:8:kworker.0 Request processed in 7384us (8581us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789597003.536551:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789597003.536580:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597003.536583:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789597003.536586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984863488:0@lo:8:kworker.0 00000004:00080000:3.0:1789597003.536620:0:17789:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789597003.536748:0:17789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 578355069085ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789597003.536754:0:17789:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789597003.538617:0:17790:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789597003.538653:0:17790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17790:1876527984864128:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789597003.538746:0:17790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597003.538774:0:17790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825ae3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597003.538807:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864128 00000100:00100000:0.0:1789597003.538814:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864128 00000100:00100000:0.0:1789597003.538872:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597003.538881:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17790:x1876527984864128:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789597003.539163:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597003.539176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984864000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597003.539207:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597003.539240:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864000 00000100:00100000:0.0:1789597003.539244:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864000 00000100:00100000:0.0:1789597003.539268:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789597003.539274:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876527984864000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597003.539293:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597003.539352:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876527984864000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597003.539358:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789597003.539403:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b6a00 x1876527984864000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597003.539435:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984864000:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789597003.541733:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789597003.543736:0:17780:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789597003.553302:0:18556:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789597003.553310:0:18556:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789597003.553409:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17790:x1876527984864128:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14525us (14658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.553419:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789597003.553541:0:17790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b7b80 x1876527984864128/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789597019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597003.553558:0:17790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17790:1876527984864128:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789597003.553572:0:17790:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789597003.553617:0:17790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17790:1876527984864256:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789597003.553657:0:17790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597003.553711:0:17790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597003.553839:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864256 00000100:00100000:3.0:1789597003.553847:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864256 00000100:00100000:3.0:1789597003.553905:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789597003.553914:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17790:x1876527984864256:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789597003.553953:0:18557:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789597003.553995:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17790:x1876527984864256:12345-0@lo:5:osp-pre-0-1.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.554002:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789597003.554160:0:17790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8442d500 x1876527984864256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789597019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597003.554171:0:17790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17790:1876527984864256:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789597003.554182:0:17790:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789597003.554208:0:17790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17790:1876527984864384:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789597003.554229:0:17790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597003.554250:0:17790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597003.554293:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864384 00000100:00100000:3.0:1789597003.554298:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864384 00000100:00100000:3.0:1789597003.554325:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789597003.554331:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17790:x1876527984864384:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789597003.554362:0:18556:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1789597003.582475:0:18551:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789597003.582500:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:3.0:1789597003.583750:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789597003.586749:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17790:x1876527984864384:12345-0@lo:5:osp-pre-0-1.0 Request processed in 32405us (32506us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789597003.586766:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789597003.587068:0:17790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8442d500 x1876527984864384/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789597019 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597003.587080:0:17790:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789597003.587086:0:17790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17790:1876527984864384:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789597003.587102:0:17790:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789597003.587167:0:17790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17790:1876527984864512:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789597003.587211:0:17790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597003.587240:0:17790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597003.587393:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864512 00000100:00100000:0.0:1789597003.587401:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864512 00000100:00100000:0.0:1789597003.587459:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597003.587469:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17790:x1876527984864512:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789597003.587531:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17790:x1876527984864512:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597003.587537:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789597003.587565:0:17790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8442d500 x1876527984864512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789597019 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597003.587575:0:17790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17790:1876527984864512:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789597003.713071:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789597003.713097:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984864640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597003.713168:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597003.713212:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864640 00000100:00100000:3.0:1789597003.713220:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864640 00000100:00100000:3.0:1789597003.713264:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789597003.713273:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984864640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789597003.713309:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789597003.713371:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984864640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597003.713378:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789597003.713436:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984864640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597003.713807:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789597003.713819:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984864768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597003.713852:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597003.713913:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864768 00000100:00100000:1.0:1789597003.713918:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864768 00000100:00100000:1.0:1789597003.713967:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789597003.713985:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984864768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597003.714008:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597003.714047:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984864768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597003.714053:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789597003.714084:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984864768:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789597004.094286:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789597004.605464:0:18922:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789597005.132166:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789597006.004793:0:18974:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789597006.006838:0:18974:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789597006.149100:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597006.589416:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596986/real 1789596986] req@ffff9c7d831b4000 x1876527984853888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597006.589447:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d831b4000 x1876527984853888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597006.589459:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596986/real 1789596986] req@ffff9c7d831b4e00 x1876527984854016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597006.589470:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7d831b4e00 x1876527984854016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789597006.589488:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597006.589508:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789597006.589512:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984853888:0@lo:8:kworker.0 00000100:00080000:2.0:1789597006.589519:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597006.589524:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789597006.589527:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d831b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984854016:0@lo:8:kworker.0 00000100:00080000:3.0:1789597006.589825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597006.589830:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789597006.589841:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597006.589846:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1789597006.589852:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789597006.589866:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7ebaf79800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597006.589890:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83ef8a80 x1876527984865152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597006.589904:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597006.589907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789597006.589909:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597006.589912:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1789597006.589915:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789597006.589919:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597006.589930:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83efa680 x1876527984865280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597006.589981:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597006.589985:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789597006.589987:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597006.589990:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 578 00000100:00080000:3.0:1789597006.589993:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789597006.589998:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597006.590008:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83ef8380 x1876527984865792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597006.590048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984865536:0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590114:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597006.590158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984866176:0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597006.590204:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789597006.590210:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984865408:0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590229:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597006.590243:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984866048:0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597006.590284:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865536 00000100:00100000:3.0:1789597006.590307:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865536 00000100:00100000:3.0:1789597006.590358:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789597006.590367:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984865536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590420:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984865536:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597006.590426:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789597006.590448:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866176 00000100:00100000:3.0:1789597006.590451:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866176 00000100:00100000:3.0:1789597006.590485:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865408 00000100:00100000:3.0:1789597006.590488:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865408 00000100:00100000:3.0:1789597006.590499:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866048 00000100:00100000:3.0:1789597006.590501:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866048 00000100:00100000:3.0:1789597006.590516:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789597006.590522:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984866176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590553:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984866176:12345-0@lo:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597006.590560:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789597006.590573:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789597006.590579:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984865408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590622:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984865408:12345-0@lo:400:kworker.0 Request processed in 43us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597006.590628:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789597006.590640:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789597006.590646:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984866048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590722:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984866048:12345-0@lo:400:kworker.0 Request processed in 76us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597006.590729:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789597006.590752:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789597006.590755:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789597006.590807:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83ef9500 x1876527984865408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597006.590820:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984865408:0@lo:400:kworker.0 00010000:00080000:3.0:1789597006.590830:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83efb480 x1876527984866048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597006.590839:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984866048:0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.590847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984865536:0@lo:400:kworker.0 00010000:00080000:3.0:1789597006.590856:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83ef9c00 x1876527984866176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597006.590863:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984866176:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.591099:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984864896:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.591138:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984865664:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.591204:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591227:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789597006.591233:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984865024:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.591253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591283:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984865920:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.591306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591336:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865664 00000100:00100000:2.0:1789597006.591341:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865664 00000100:00100000:2.0:1789597006.591380:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597006.591388:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984865664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.591427:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984865664:12345-0@lo:400:kworker.0 Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597006.591432:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789597006.591451:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597006.591461:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984865152:0@lo:8:kworker.0 00000100:00100000:2.0:1789597006.591487:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591506:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984865280:0@lo:8:kworker.0 00000100:00100000:2.0:1789597006.591525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984865792:0@lo:8:kworker.0 00000100:00100000:2.0:1789597006.591561:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597006.591587:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865152 00000100:00100000:2.0:1789597006.591591:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865152 00000100:00100000:2.0:1789597006.591605:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865280 00000100:00100000:2.0:1789597006.591607:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865280 00000100:00100000:2.0:1789597006.591614:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865792 00000100:00100000:2.0:1789597006.591616:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865792 00000100:00100000:2.0:1789597006.591626:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789597006.591630:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984865152:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789597006.591656:0:18557:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:2.0:1789597006.591774:0:18557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfcfa 00002000:00100000:2.0:1789597006.591791:0:18557:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c7d83c89800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789597006.591804:0:18557:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789597006.591807:0:18557:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789597006.591900:0:18557:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789597006.591923:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c8c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597006.591975:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984865152:12345-0@lo:8:kworker.0 Request processed in 344us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597006.591982:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789597006.591996:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597006.592001:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984865280:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789597006.592013:0:18557:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597006.592037:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984865280:12345-0@lo:8:kworker.0 Request processed in 34us (510us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597006.592042:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597006.592052:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597006.592056:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984865792:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789597006.592065:0:18557:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597006.592083:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984865792:12345-0@lo:8:kworker.0 Request processed in 26us (522us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597006.592089:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789597006.592402:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83efb100 x1876527984865664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789597022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597006.592416:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984865664:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.592441:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865920 00000100:00100000:2.0:1789597006.592445:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865920 00000100:00100000:2.0:1789597006.592476:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789597006.592492:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984865920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.592534:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984865920:12345-0@lo:400:kworker.0 Request processed in 43us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597006.592540:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789597006.592574:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83ef8a80 x1876527984865152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597006.592583:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789597006.592590:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789597006.592599:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789597006.592605:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789597006.592608:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789597006.592632:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789597006.592638:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984865152:0@lo:8:kworker.0 00000100:00080000:2.0:1789597006.592649:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597006.592653:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597006.592656:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984865280:0@lo:8:kworker.0 00000100:00080000:2.0:1789597006.592663:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597006.592666:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597006.592669:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984865792:0@lo:8:kworker.0 00010000:00080000:2.0:1789597006.592722:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83ef8000 x1876527984865920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597006.592732:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984865920:0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.592840:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984864896 00000100:00100000:3.0:1789597006.592845:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984864896 00000100:00100000:3.0:1789597006.592874:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789597006.592881:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:3644:x1876527984864896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597006.592925:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:3644:x1876527984864896:12345-0@lo:400:kworker.0 Request processed in 44us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597006.592931:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789597006.594028:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984865024 00000100:00100000:1.0:1789597006.594039:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984865024 00000100:00100000:1.0:1789597006.594080:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789597006.594088:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984865024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597006.594153:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984865024:12345-0@lo:400:kworker.0 Request processed in 65us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597006.594160:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789597006.594378:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984865024:0@lo:400:kworker.0 00000100:00100000:2.0:1789597006.594391:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984864896:0@lo:400:kworker.0 00000004:00080000:0.0:1789597006.595344:0:17072:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1789597006.595377:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1876527984866432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789597006.595444:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597006.595469:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9187c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789597006.595505:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866432 00000100:00100000:0.0:1789597006.595514:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866432 00000100:00100000:0.0:1789597006.595568:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789597006.595576:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17072:x1876527984866432:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789597006.596035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597006.596050:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984866304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789597006.596096:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789597006.596562:0:17071:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789597006.596666:0:17071:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 581414986093ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789597006.596673:0:17071:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789597006.596747:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866304 00000100:00100000:0.0:1789597006.596755:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866304 00000100:00100000:0.0:1789597006.596800:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597006.596808:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876527984866304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789597006.596840:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597006.596904:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876527984866304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597006.596910:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789597006.597104:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b4e00 x1876527984866304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597006.597125:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984866304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789597006.597348:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789597006.599599:0:18556:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789597006.599615:0:18556:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789597006.599623:0:18556:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:1.0:1789597006.600326:0:17026:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789597006.608891:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.608905:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.608927:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.608932:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.608939:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.608970:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.608994:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.609003:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.609022:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597006.609423:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.609433:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.609443:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.609448:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.609475:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.609498:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.609506:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfd01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.609527:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.609529:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.609530:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597006.609937:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.609956:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.609966:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.609970:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.609974:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.609984:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.609991:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.609998:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.610067:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789597006.611752:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.611766:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.611784:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.611790:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.611795:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.611809:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.611819:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.611827:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614166:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597006.614188:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614204:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.614210:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614221:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614250:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614259:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955aee25/0x7b5398e289bbfd08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614285:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.614289:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614295:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.614299:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614306:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614337:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.614345:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.614347:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.614349:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597006.614556:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789597006.614565:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfd0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789597006.615659:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.615669:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.615724:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.615730:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.615737:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.615752:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.615763:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.615771:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.615825:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.615832:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.615840:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.615844:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.615854:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.615869:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.615891:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.615893:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.615895:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597006.616561:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789597006.616570:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfd16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.617016:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597006.617155:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.617162:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.617176:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.617181:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.617186:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.617210:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.617220:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.617229:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.618537:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789597006.623345:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.623366:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.623388:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.623393:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.623400:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.623416:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.623428:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.623437:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627018:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597006.627034:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627050:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.627056:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627068:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627091:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627099:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a198a7f/0x7b5398e289bbfd1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627118:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.627122:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627128:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833ddc00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.627145:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627154:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627164:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.627171:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.627173:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.627175:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.628020:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789597006.628045:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010245b4e/0x7b5398e289bbfd24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.628778:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597006.629634:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.629646:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.629663:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.629668:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.629675:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.629772:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.629783:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.629792:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.629849:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789597006.630746:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.630756:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.630768:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.630784:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.630790:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.630801:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.630810:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.630818:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.635929:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597006.635955:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.635970:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.635976:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.635991:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636017:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636025:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a18d7b/0x7b5398e289bbfd2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636054:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.636059:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636066:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.636069:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636077:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636087:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.636094:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.636096:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.636098:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.639711:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789597006.639729:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba3550e/0x7b5398e289bbfd32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789597006.642120:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.642136:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.642155:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.642161:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.642168:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.642186:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.642208:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.642218:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.643337:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.643351:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.643364:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.643369:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.643396:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.643429:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.643439:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.643441:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.643443:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.645643:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789597006.645664:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8037ad/0x7b5398e289bbfd39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789597006.647000:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.647013:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.647031:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.647037:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.647044:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.647060:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.647072:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.647092:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.647380:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.647389:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.647456:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.647462:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.647543:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.647564:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.647574:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.647575:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.647577:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.649713:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789597006.649729:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ce12274/0x7b5398e289bbfd40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.649971:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597006.650756:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.650768:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.650786:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.650792:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.650798:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.650816:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.650828:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.650836:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.650873:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597006.651107:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597006.651116:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651126:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597006.651131:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651141:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651164:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651172:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69e70fc/0x7b5398e289bbfd47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651190:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.651192:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.651194:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597006.651352:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597006.651358:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.651367:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1789597006.651371:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597006.651375:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.651385:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.651393:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.651401:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.651422:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597006.651540:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597006.651547:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651556:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597006.651559:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651568:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651580:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651587:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bbfd4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.651601:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.651603:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.651604:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.654371:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.654390:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.654409:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.654415:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.654421:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.654455:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663156:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663186:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663214:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597006.663234:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597006.663240:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663248:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597006.663254:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663267:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663289:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663297:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071726813/0x7b5398e289bbfd55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.663323:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.663325:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.663327:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.664050:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.664058:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664072:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.664076:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.664082:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664095:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664104:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664111:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664126:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597006.664134:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597006.664139:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664160:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597006.664164:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664172:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664183:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664190:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efc1aba5/0x7b5398e289bbfd5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664206:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.664207:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.664209:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.664643:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.664650:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664658:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.664661:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.664665:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664712:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664737:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664745:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.664766:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597006.665111:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.665119:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665129:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.665140:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665149:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665163:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665171:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e117cc7/0x7b5398e289bbfd63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665186:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.665187:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.665189:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.665278:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.665284:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665293:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.665296:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.665300:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665309:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665317:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665324:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665359:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597006.665606:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.665612:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665620:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.665624:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665633:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665645:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665659:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394baa16/0x7b5398e289bbfd6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.665674:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.665693:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.665696:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.665845:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.665852:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665861:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.665864:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.665868:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665878:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665886:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665894:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.665918:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597006.666183:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.666190:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666199:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.666208:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.666213:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666224:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666233:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666241:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666254:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789597006.666493:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597006.666499:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666508:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.666512:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666520:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666535:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666543:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d75610bf/0x7b5398e289bbfd71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666560:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.666563:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666579:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.666582:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666590:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666601:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666609:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071f11f56/0x7b5398e289bbfd78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.666621:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.666623:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.666625:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.666632:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.666916:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.666923:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666934:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.666938:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.666956:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666968:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666976:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.666991:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.667045:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597006.667515:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.667521:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.667530:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.667533:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.667537:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.667546:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.667553:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.667560:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669203:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597006.669217:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669230:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.669236:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669261:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669281:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669289:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c026bda3/0x7b5398e289bbfd7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669311:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.669315:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669321:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.669324:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669332:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669341:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.669349:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.669350:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.669359:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.669491:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597006.669499:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5d54dd/0x7b5398e289bbfd86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597006.670815:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.670827:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.670845:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.670850:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.670857:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.670872:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.670883:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.670891:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.674425:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.674445:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.674463:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.674478:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.674491:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.674516:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.674528:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.674530:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.674532:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597006.675624:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597006.675639:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfd8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597006.676241:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.676251:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676279:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.676285:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.676292:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676309:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676320:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676330:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676349:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597006.676666:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.676675:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.676701:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.676706:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.676717:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.676752:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.676760:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb23353f/0x7b5398e289bbfd94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.676780:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.676783:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.676785:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.676794:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597006.676908:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597006.676914:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676923:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=581s v=(0 0) 00010000:00010000:3.0:1789597006.676926:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597006.676931:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676940:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676974:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.676982:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597006.677040:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789597006.679389:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.679405:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.679426:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.679431:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.679436:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.679450:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.679460:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.683137:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683578:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597006.683592:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683604:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.683610:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683624:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683653:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683661:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002993969/0x7b5398e289bbfd9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683726:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.683730:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683737:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.683740:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683748:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683759:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.683767:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.683768:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.683770:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597006.686398:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789597006.686414:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120d6317/0x7b5398e289bbfda2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.686566:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597006.687265:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.687275:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.687467:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.687598:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.687608:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.687628:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.687640:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.687649:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.688412:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597006.689101:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597006.689112:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.689125:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.689131:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.689154:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.689175:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.689183:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e2cdec3/0x7b5398e289bbfda9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.689207:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.689209:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.689211:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597006.692938:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.692970:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.692995:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.693001:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.693009:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.693027:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.693040:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.693048:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.693899:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789597006.695715:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597006.695732:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.695752:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1789597006.695765:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597006.695772:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.695790:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.695802:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.695809:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.698927:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597006.698957:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.698974:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597006.698980:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.698993:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.699018:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597006.699043:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443f916d/0x7b5398e289bbfdb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597006.700278:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789597006.700404:0:18556:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:0.0:1789597006.700789:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597006.700801:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.700816:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597006.700821:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.700834:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.700855:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.700863:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bbfdb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597006.700889:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.700891:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597006.700894:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597006.701147:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597006.707275:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17072:x1876527984866432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 111682us (111814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597006.707303:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789597006.707463:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1876527984866432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789597006.707617:0:17072:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1789597006.710388:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1876527984866560:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789597006.711004:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597006.711053:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9187c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789597006.711120:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866560 00000100:00100000:2.0:1789597006.711133:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866560 00000100:00100000:2.0:1789597006.711207:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597006.711218:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17072:x1876527984866560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789597006.711281:0:18554:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789597006.719795:0:18551:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1789597006.719875:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789597006.720717:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17072:x1876527984866560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9455us (9669us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789597006.720732:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789597006.721008:0:17072:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789597006.721020:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1876527984866560:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789597006.721038:0:17072:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:3.0:1789597006.966408:0:19024:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597006.968140:0:19024:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789597007.165039:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597008.190254:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597008.828977:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597008.829009:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984866688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597008.829098:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597008.829159:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866688 00000100:00100000:3.0:1789597008.829169:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866688 00000100:00100000:3.0:1789597008.829242:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789597008.829254:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984866688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789597008.829295:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789597008.829349:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984866688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597008.829357:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789597008.829405:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984866688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597008.831250:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597008.831280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984866816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597008.831372:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597008.831446:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866816 00000100:00100000:0.0:1789597008.831464:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866816 00000100:00100000:0.0:1789597008.831535:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597008.831545:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984866816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597008.831580:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789597008.831602:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597008.831652:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984866816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597008.831660:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789597008.831795:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984866816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597008.839433:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789597008.845978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984866944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789597008.846076:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597008.846262:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984866944 00000100:00100000:0.0:1789597008.846271:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984866944 00000100:00100000:0.0:1789597008.846335:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789597008.846346:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984866944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789597008.846396:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597008.846621:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984866944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 276us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597008.846630:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789597008.852656:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984866944:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789597009.213027:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597010.237510:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789597010.960048:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789597011.269620:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597011.901914:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984867072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597011.901998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597011.902088:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867072 00000100:00100000:1.0:1789597011.902096:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867072 00000100:00100000:1.0:1789597011.902155:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597011.902166:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984867072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789597011.902199:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597011.902249:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984867072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597011.902256:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789597011.902277:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597011.902315:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984867072:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789597011.906422:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597011.906429:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597011.906439:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597011.906447:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:2.0:1789597011.906452:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789597011.906464:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597011.906488:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83e78a80 x1876527984867456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789597011.906525:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597011.906529:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597011.906531:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597011.906534:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 581 00000100:00080000:2.0:1789597011.906536:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789597011.906541:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597011.906554:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d8442df80 x1876527984867968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789597011.906610:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984867328:0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.906694:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597011.907107:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984868096:0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.907137:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597011.907167:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789597011.907172:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984867584:0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.907189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597011.907203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.907218:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597011.907241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984867456:0@lo:8:kworker.0 00000100:00100000:2.0:1789597011.907276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597011.907292:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984867968:0@lo:8:kworker.0 00000100:00100000:2.0:1789597011.907309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597011.907336:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867328 00000100:00100000:2.0:1789597011.907343:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867328 00000100:00100000:2.0:1789597011.907382:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789597011.907390:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984867328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.907441:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984867328:12345-0@lo:400:kworker.0 Request processed in 52us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597011.907448:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789597011.907472:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868096 00000100:00100000:2.0:1789597011.907475:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868096 00000100:00100000:2.0:1789597011.907492:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867584 00000100:00100000:2.0:1789597011.907494:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867584 00000100:00100000:2.0:1789597011.907502:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868224 00000100:00100000:2.0:1789597011.907504:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868224 00000100:00100000:2.0:1789597011.907522:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597011.907527:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984868096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.907552:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984868096:12345-0@lo:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597011.907557:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789597011.907758:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867456 00000100:00100000:1.0:1789597011.907763:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867456 00000100:00100000:1.0:1789597011.907785:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867968 00000100:00100000:1.0:1789597011.907788:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867968 00000100:00100000:1.0:1789597011.907797:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789597011.907802:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876527984867456:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789597011.907826:0:18556:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597011.909152:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789597011.909165:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984867584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.909235:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984867584:12345-0@lo:400:kworker.0 Request processed in 74us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597011.909240:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789597011.909249:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597011.909264:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984868224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.909290:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984868224:12345-0@lo:400:kworker.0 Request processed in 28us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597011.909295:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789597011.909350:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83e78000 x1876527984867584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597011.909365:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984867584:0@lo:400:kworker.0 00010000:00080000:2.0:1789597011.909376:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83defb80 x1876527984868224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597011.909384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.909394:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984867328:0@lo:400:kworker.0 00010000:00080000:2.0:1789597011.909403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83dec700 x1876527984868096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597011.909410:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984868096:0@lo:400:kworker.0 00000100:00100000:3.0:1789597011.914955:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984867200:0@lo:400:kworker.0 00000100:00100000:3.0:1789597011.915043:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597011.915096:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984867840:0@lo:400:kworker.0 00000100:00100000:3.0:1789597011.915137:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597011.915176:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789597011.915183:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984867712:0@lo:400:kworker.0 00000100:00100000:3.0:1789597011.915210:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597011.915236:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984868352:0@lo:400:kworker.0 00000100:00100000:3.0:1789597011.915260:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597011.915293:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867200 00000100:00100000:3.0:1789597011.915301:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867200 00000100:00100000:3.0:1789597011.915347:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789597011.915357:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:3645:x1876527984867200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597011.915415:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:3645:x1876527984867200:12345-0@lo:400:kworker.0 Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597011.915422:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789597011.915480:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984867200:0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.918203:0:18557:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789597011.918220:0:18557:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789597011.918257:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868352 00000100:00100000:2.0:1789597011.918268:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868352 00000100:00100000:2.0:1789597011.918326:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789597011.918335:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984868352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597011.918432:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984868352:12345-0@lo:400:kworker.0 Request processed in 98us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597011.918438:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789597011.918498:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83def480 x1876527984868352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597011.918530:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984868352:0@lo:400:kworker.0 00000100:00100000:0.0:1789597011.918862:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867712 00000100:00100000:0.0:1789597011.918868:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867712 00000100:00100000:0.0:1789597011.918912:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789597011.918919:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984867712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597011.918966:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984867712:12345-0@lo:400:kworker.0 Request processed in 48us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597011.918979:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789597011.919024:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984867712:0@lo:400:kworker.0 00000100:00080000:0.0:1789597011.926192:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597011.926201:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789597011.939873:0:18554:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789597011.939914:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984867840 00000100:00100000:0.0:1789597011.939927:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984867840 00000100:00100000:0.0:1789597011.939993:0:18554:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789597011.940007:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597011.940017:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984867840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597011.940136:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984867840:12345-0@lo:400:kworker.0 Request processed in 119us (24996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597011.940143:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597011.940203:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984867840:0@lo:400:kworker.0 00000100:00080000:0.0:1789597011.940231:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597011.951229:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876527984867456:12345-0@lo:8:kworker.0 Request processed in 43419us (43945us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789597011.951243:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789597011.951284:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789597011.951290:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876527984867968:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789597011.951314:0:18556:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789597011.951341:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876527984867968:12345-0@lo:8:kworker.0 Request processed in 51us (44031us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789597011.951347:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789597011.952575:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597011.952585:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597011.952591:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984867456:0@lo:8:kworker.0 00000100:00080000:2.0:1789597011.952603:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597011.952607:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597011.952610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984867968:0@lo:8:kworker.0 00010000:00010000:0.0:1789597012.286009:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597013.311708:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789597013.821605:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789597013.949116:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984868480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597013.949213:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597013.949308:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868480 00000100:00100000:1.0:1789597013.949324:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868480 00000100:00100000:1.0:1789597013.949502:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597013.949513:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984868480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597013.949546:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597013.949597:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984868480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597013.949603:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789597013.949983:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984868480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789597013.950326:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984868608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597013.950376:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597013.950422:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868608 00000100:00100000:3.0:1789597013.950427:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868608 00000100:00100000:3.0:1789597013.950468:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789597013.950476:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984868608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789597013.950499:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597013.950534:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984868608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597013.950541:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789597013.950592:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984868608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789597013.951375:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789597013.951652:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984868736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597013.951754:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597013.952638:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868736 00000100:00100000:0.0:1789597013.952650:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868736 00000100:00100000:0.0:1789597013.952728:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789597013.952745:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984868736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597013.952779:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789597013.958054:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984868736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5294us (6283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597013.958071:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789597013.958548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984868736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789597014.333483:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789597015.220530:0:19370:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789597015.220535:0:19370:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789597015.220537:0:19370:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789597015.220661:0:19370:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7e875ed800 00000020:01000004:0.0:1789597015.220675:0:19370:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789597015.220716:0:19370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789597015.220730:0:19370:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7e9e358000) 00000020:00000080:0.0:1789597015.220745:0:19370:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789597015.293610:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789597015.299758:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789597015.300256:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789597015.300673:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789597015.302449:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789597015.303365:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789597015.304410:0:19370:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789597015.307358:0:19370:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789597015.307588:0:19370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789597015.307605:0:19370:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789597015.307619:0:19370:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7b5398e289bbfdc5 00000020:01000004:0.0:1789597015.307628:0:19370:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789597015.307652:0:19370:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789597015.307655:0:19370:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789597015.307662:0:19370:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789597015.308289:0:19370:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789597015.308307:0:19370:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789597015.330640:0:19370:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789597015.330914:0:19370:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789597015.330920:0:19370:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789597015.330922:0:19370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597015.330923:0:19370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597015.330925:0:19370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597015.330926:0:19370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597015.330927:0:19370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597015.330929:0:19370:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597015.330932:0:19370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597015.330934:0:19370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789597015.330938:0:19370:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789597015.330941:0:19370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789597015.330943:0:19370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597015.330944:0:19370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597015.330945:0:19370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597015.330946:0:19370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597015.330948:0:19370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597015.330949:0:19370:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597015.330950:0:19370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597015.330951:0:19370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789597015.331003:0:19370:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789597015.331028:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984868864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789597015.331240:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.331543:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868864 00000100:00100000:0.0:1789597015.331551:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868864 00000100:00100000:0.0:1789597015.331642:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789597015.331653:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:19370:x1876527984868864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789597015.331750:0:17040:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789597015.331754:0:17040:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789597015.331760:0:17040:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789597015.332278:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:19370:x1876527984868864:12345-0@lo:253:mount.lustre.0 Request processed in 625us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.332287:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789597015.332937:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789597015.332976:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984868864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789597015.332991:0:19370:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789597015.332994:0:19370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789597015.332996:0:19370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597015.333008:0:19370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597015.333010:0:19370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597015.333011:0:19370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597015.333013:0:19370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597015.333014:0:19370:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597015.333016:0:19370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597015.333018:0:19370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789597015.333042:0:19370:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7e875ed800 from lustre-OST0001 10000000:01000000:3.0:1789597015.333217:0:19370:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789597015.333221:0:19370:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789597015.333230:0:19370:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7d83514d40 local copy 00010000:00010000:3.0:1789597015.333239:0:19370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597015.333419:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984868992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597015.333464:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597015.333543:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.333638:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984868992 00000100:00100000:0.0:1789597015.333645:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984868992 00000100:00100000:0.0:1789597015.338221:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789597015.338250:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:19370:x1876527984868992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597015.338435:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:19370:x1876527984868992:12345-0@lo:501:mount.lustre.0 Request processed in 200us (4970us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789597015.338444:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789597015.339484:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984868992:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789597015.339511:0:19370:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789597015.339544:0:19370:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789597015.339555:0:19370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.339566:0:19370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597015.339603:0:19370:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7e875ed800 10000000:01000000:3.0:1789597015.339610:0:19370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789597015.339616:0:19370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789597015.339619:0:19370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789597015.339624:0:19370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789597015.339636:0:19370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789597015.339670:0:19370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.339715:0:19370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.339725:0:19370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597015.339746:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597015.339801:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597015.339836:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.339916:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869120 00000100:00100000:0.0:1789597015.339923:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869120 00000100:00100000:0.0:1789597015.340014:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789597015.340024:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+21:19370:x1876527984869120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597015.340038:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597015.340050:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfdd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfdcc expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.340074:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfdd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfdcc expref: 22 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.340097:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfdd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfdcc expref: 22 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.340105:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743000, rc 0) 00000100:00100000:0.0:1789597015.340152:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869120:12345-0@lo:101:mount.lustre.0 Request processed in 130us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.340159:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789597015.340227:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597015.340240:0:19370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.340249:0:19370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789597015.342006:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789597015.343531:0:19370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789597015.347108:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789597015.347169:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789597015.347178:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789597015.347187:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789597015.347194:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789597015.347201:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789597015.347219:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789597015.347222:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789597015.347355:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597015.347436:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597015.347477:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.347499:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869248 00000100:00100000:0.0:1789597015.347507:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869248 00000100:00100000:0.0:1789597015.347675:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789597015.347712:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597015.347885:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869248:12345-0@lo:501:mount.lustre.0 Request processed in 175us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.347894:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789597015.347999:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597015.348031:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597015.348085:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597015.352796:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597015.353232:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869376 00000100:00100000:1.0:1789597015.353243:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869376 00000100:00100000:1.0:1789597015.353304:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789597015.353314:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597015.354917:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869376:12345-0@lo:503:mount.lustre.0 Request processed in 1598us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597015.354930:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789597015.355518:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869376:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789597015.356392:0:19370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789597015.356500:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597015.356582:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597015.356630:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699180 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.357028:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869504 00000100:00100000:0.0:1789597015.357036:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869504 00000100:00100000:0.0:1789597015.357123:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789597015.357134:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869504:12345-0@lo:502:mount.lustre.0 00010000:00010000:2.0:1789597015.357964:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597015.357986:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869504:12345-0@lo:502:mount.lustre.0 Request processed in 851us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.357996:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789597015.358030:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597015.359132:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789597015.359199:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789597015.359215:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789597015.359230:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789597015.359243:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789597015.359256:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789597015.359269:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789597015.359281:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789597015.359293:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789597015.360132:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597015.361188:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.361230:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869632 00000100:00100000:3.0:1789597015.361237:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597015.361241:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869632 00000100:00100000:1.0:1789597015.361303:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789597015.361314:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597015.361773:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869632:12345-0@lo:502:mount.lustre.0 Request processed in 459us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597015.361782:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789597015.361996:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597015.362084:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789597015.362099:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789597015.363184:0:19374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789597015.363244:0:19374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789597015.363251:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597015.363253:0:19374:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789597015.363260:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789597015.363275:0:19374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c7eb557cd40) 00000020:00000080:0.0:1789597015.363297:0:19374:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789597015.363300:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789597015.363474:0:19374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7e875ed800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789597015.363483:0:19374:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789597015.363490:0:19374:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7b5398e289bbfde1 00010000:00010000:0.0:1789597015.368136:0:19374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789597015.372155:0:19374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789597015.374530:0:19374:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789597015.376485:0:19374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789597015.376503:0:19374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597015.376510:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597015.376513:0:19374:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789597015.376516:0:19374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597015.376521:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597015.376523:0:19374:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789597015.376526:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789597015.376527:0:19374:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789597015.376530:0:19374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597015.376532:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597015.376534:0:19374:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789597015.376536:0:19374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597015.376538:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597015.376539:0:19374:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789597015.376542:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789597015.376575:0:19374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597015.376578:0:19374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597015.376580:0:19374:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789597015.376583:0:19374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789597015.376873:0:19370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789597015.376911:0:19370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789597015.376931:0:19370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.376945:0:19370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597015.376965:0:19370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e875ed800 from 1 10000000:01000000:3.0:1789597015.376969:0:19370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597015.377007:0:19370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.377014:0:19370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.377025:0:19370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597015.377049:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597015.377126:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597015.377170:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789597015.377336:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869760 00000100:00100000:1.0:1789597015.377345:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869760 00000100:00100000:1.0:1789597015.377536:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789597015.377548:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:19370:x1876527984869760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597015.377570:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597015.377584:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfde8 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597015.377608:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597015.377621:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597015.377629:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0000, rc 0) 00000100:00100000:1.0:1789597015.377964:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984869760:12345-0@lo:101:mount.lustre.0 Request processed in 419us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597015.377970:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789597015.386400:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597015.386434:0:19370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.386447:0:19370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789597015.389574:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789597015.390164:0:19370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789597015.390551:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789597015.390578:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789597015.390616:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789597015.390623:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789597015.391311:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597015.391439:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.391497:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789597015.391561:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984869888 00000100:00100000:2.0:1789597015.391568:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984869888 00000100:00100000:2.0:1789597015.391709:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789597015.391720:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984869888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597015.391882:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984869888:12345-0@lo:501:mount.lustre.0 Request processed in 164us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.391890:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789597015.392084:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984869888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597015.392125:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597015.392174:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.392359:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870016 00000100:00100000:0.0:1789597015.392365:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870016 00000100:00100000:0.0:1789597015.392404:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789597015.392412:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597015.392497:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870016:12345-0@lo:503:mount.lustre.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.392512:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789597015.392924:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597015.392940:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870016:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789597015.393976:0:19370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789597015.395936:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597015.396029:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.396063:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.396797:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870144 00000100:00100000:0.0:1789597015.396810:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870144 00000100:00100000:0.0:1789597015.396908:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789597015.396919:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597015.397085:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870144:12345-0@lo:502:mount.lustre.0 Request processed in 168us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.397093:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789597015.397412:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597015.397960:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789597015.398001:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789597015.398015:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789597015.398028:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789597015.398041:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789597015.398055:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789597015.398069:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789597015.398082:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789597015.398095:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789597015.398107:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789597015.398120:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789597015.398164:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597015.398317:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.398369:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597015.398495:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870272 00000100:00100000:2.0:1789597015.398502:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870272 00000100:00100000:2.0:1789597015.398572:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789597015.398584:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597015.398754:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870272:12345-0@lo:502:mount.lustre.0 Request processed in 174us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.398762:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789597015.399089:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597015.399155:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789597015.399166:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789597015.402068:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597015.402082:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402084:0:19378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789597015.402091:0:19378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7e875ed800 00000020:00000080:3.0:1789597015.402093:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597015.402102:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597015.402104:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402105:0:19378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789597015.402107:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597015.402109:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402110:0:19378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789597015.402113:0:19378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7e875ed800 00000020:00000080:3.0:1789597015.402114:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597015.402178:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597015.402182:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402183:0:19378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789597015.402197:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597015.402200:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402202:0:19378:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789597015.402205:0:19378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7e875ed800 00000020:00000080:3.0:1789597015.402207:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597015.402240:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597015.402244:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402245:0:19378:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789597015.402248:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597015.402250:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402252:0:19378:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789597015.402255:0:19378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7e875ed800 00000020:00000080:3.0:1789597015.402257:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597015.402282:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597015.402285:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597015.402286:0:19378:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789597015.402289:0:19378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789597015.402468:0:19370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789597015.402497:0:19370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789597015.402519:0:19370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597015.402530:0:19370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597015.402591:0:19370:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789597015.402594:0:19370:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7e875ed800 10000000:01000000:1.0:1789597015.402597:0:19370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7e875ed800 10000000:01000000:1.0:1789597015.402601:0:19370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789597015.402606:0:19370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e875ed800 from 1 10000000:01000000:1.0:1789597015.402609:0:19370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789597015.402651:0:19370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597015.402658:0:19370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597015.402669:0:19370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597015.402718:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597015.402789:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.402844:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597015.403116:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870400 00000100:00100000:3.0:1789597015.403125:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870400 00000100:00100000:3.0:1789597015.403495:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789597015.403506:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+23:19370:x1876527984870400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597015.403522:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597015.403538:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81511c00/0x7b5398e289bbfdfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfdf6 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.403573:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81511c00/0x7b5398e289bbfdfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfdf6 expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.403583:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81511c00/0x7b5398e289bbfdfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfdf6 expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597015.403591:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81511c00, rc 0) 00000100:00100000:3.0:1789597015.403668:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870400:12345-0@lo:101:mount.lustre.0 Request processed in 164us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597015.403703:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789597015.403799:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597015.403814:0:19370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.403823:0:19370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789597015.405671:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789597015.406081:0:19370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789597015.406518:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789597015.407005:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789597015.407032:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789597015.407049:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789597015.407061:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789597015.407075:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789597015.407088:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789597015.407101:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789597015.407115:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789597015.407127:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789597015.407140:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789597015.407166:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789597015.407192:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789597015.407207:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789597015.407220:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789597015.407233:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789597015.407264:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789597015.407281:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789597015.407293:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789597015.407322:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789597015.407337:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789597015.407348:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789597015.407360:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789597015.407375:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789597015.407389:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789597015.407404:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789597015.407416:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789597015.407427:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789597015.407439:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789597015.407987:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789597015.408014:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789597015.408028:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789597015.408060:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789597015.408075:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789597015.408087:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789597015.408098:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789597015.408111:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789597015.408123:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789597015.408135:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789597015.408161:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789597015.408178:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789597015.408192:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789597015.408204:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789597015.408218:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789597015.408233:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789597015.408258:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789597015.408287:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789597015.408293:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789597015.408415:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597015.408871:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.408929:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597015.409622:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870528 00000100:00100000:3.0:1789597015.409810:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870528 00000100:00100000:3.0:1789597015.409929:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789597015.409939:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597015.410125:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870528:12345-0@lo:501:mount.lustre.0 Request processed in 187us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597015.410134:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789597015.410245:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597015.410304:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597015.410358:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.410732:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e932e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789597015.410929:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870656 00000100:00100000:1.0:1789597015.410938:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870656 00000100:00100000:1.0:1789597015.410974:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789597015.410982:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597015.411262:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870656:12345-0@lo:503:mount.lustre.0 Request processed in 281us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597015.411270:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789597015.411529:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789597015.412520:0:19370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789597015.413055:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597015.413279:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.413356:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.413406:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870784 00000100:00100000:0.0:1789597015.413419:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870784 00000100:00100000:0.0:1789597015.413643:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789597015.413653:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597015.413803:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870784:12345-0@lo:502:mount.lustre.0 Request processed in 151us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.413810:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789597015.413902:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597015.414129:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789597015.414428:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789597015.414446:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789597015.414473:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789597015.414488:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789597015.414502:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789597015.414515:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789597015.414528:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789597015.414542:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789597015.414570:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789597015.414583:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789597015.414611:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789597015.414624:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789597015.414650:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789597015.414853:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789597015.414886:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789597015.414900:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789597015.414914:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789597015.414927:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789597015.414940:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789597015.414951:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789597015.414964:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789597015.415032:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789597015.415054:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789597015.415082:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789597015.415098:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789597015.415110:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789597015.415123:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789597015.415135:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789597015.415146:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789597015.415318:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789597015.415335:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789597015.415349:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789597015.415363:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789597015.415377:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789597015.415391:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789597015.415404:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789597015.415417:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789597015.415429:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789597015.415441:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789597015.415454:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789597015.415467:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789597015.415481:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789597015.415495:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789597015.415523:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789597015.415537:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789597015.415577:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789597015.415592:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789597015.415890:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597015.416019:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.416421:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789597015.416525:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984870912 00000100:00100000:3.0:1789597015.416534:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984870912 00000100:00100000:3.0:1789597015.416961:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789597015.416971:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597015.417325:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984870912:12345-0@lo:502:mount.lustre.0 Request processed in 355us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597015.417334:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789597015.417972:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984870912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597015.418347:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789597015.418376:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789597015.418414:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984871040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597015.418542:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.420312:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789597015.423831:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871040 00000100:00100000:3.0:1789597015.423850:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871040 00000100:00100000:3.0:1789597015.423919:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789597015.423929:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984871040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597015.426817:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984871040:12345-0@lo:502:mount.lustre.0 Request processed in 2879us (8264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597015.426834:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789597015.434924:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984871040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789597015.435629:0:19370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789597015.436152:0:19370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789597015.442890:0:19383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789597015.442909:0:19383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c7eb557b380) 00000020:00000080:0.0:1789597015.442938:0:19383:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1789597015.443042:0:19383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7e875ed800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789597015.443048:0:19383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e875ed800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789597015.443050:0:19383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e875ed800 3 00010000:00080000:0.0:1789597015.443473:0:19383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d83164800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789597015.446396:0:19383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1789597015.448212:0:19383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789597015.448273:0:19383:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789597015.448307:0:19383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7b5398e289bbfe0b 00000100:00080000:0.0:1789597015.448321:0:19383:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789597015.448335:0:19383:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7d83164800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597015.448391:0:19383:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b7800 x1876527984871168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597015.448477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984871168:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597015.448571:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789597015.448927:0:19383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789597015.448991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597015.448995:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789597015.449005:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597015.449010:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1789597015.449013:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789597015.449022:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597015.449039:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb98d4000 x1876527984871552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789597015.451471:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871168 00000100:00100000:2.0:1789597015.451491:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871168 00000100:00100000:2.0:1789597015.451553:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789597015.451565:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984871168:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789597015.451598:0:17048:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000100:00100000:3.0:1789597015.451628:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984871552:0@lo:8:kworker.0 00000020:00000080:2.0:1789597015.451654:0:17048:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7b5398e289bbfe12 00000004:00100000:2.0:1789597015.451705:0:17048:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789597015.451750:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c88000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597015.452003:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876527984871168:12345-0@lo:38:llog_process_th.0 Request processed in 439us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.452011:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789597015.452873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789597015.452946:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b7800 x1876527984871168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597015.452960:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597015.452973:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789597015.452984:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789597015.452991:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789597015.452995:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789597015.453002:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984871168:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1789597015.453880:0:19383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789597015.453900:0:19383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c7eb76cb380) 00000020:00000080:3.0:1789597015.453937:0:19383:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789597015.454037:0:19383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7e875ed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789597015.454041:0:19383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e875ed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789597015.454044:0:19383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e875ed800 3 00010000:00080000:3.0:1789597015.454624:0:19383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d83f21800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.116@tcp at head 00000100:00100000:0.0:1789597015.454941:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871552 00000100:00100000:0.0:1789597015.454958:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871552 00000100:00100000:0.0:1789597015.455010:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789597015.455018:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984871552:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789597015.456247:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984871552:12345-0@lo:8:kworker.0 Request processed in 1221us (3377us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789597015.456259:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789597015.456300:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984871296:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.456340:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.456372:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597015.456379:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984871424:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.456401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.457619:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789597015.457633:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789597015.457640:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789597015.457644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984871552:0@lo:8:kworker.0 00000100:00100000:0.0:1789597015.458669:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871424 00000100:00100000:0.0:1789597015.458832:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871424 00000100:00100000:0.0:1789597015.458928:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597015.458938:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984871424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.459041:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984871424:12345-0@lo:400:kworker.0 Request processed in 105us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.459048:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597015.459763:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871296 00000100:00100000:0.0:1789597015.459773:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871296 00000100:00100000:0.0:1789597015.459812:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789597015.459820:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984871296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.460170:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984871296:12345-0@lo:400:kworker.0 Request processed in 349us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.460179:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789597015.460209:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597015.460264:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984871424:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.460279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984871296:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.460365:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984871680:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.460406:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.460446:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871680 00000100:00100000:0.0:1789597015.460450:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871680 00000100:00100000:0.0:1789597015.461991:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789597015.462001:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984871680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.463330:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984871680:12345-0@lo:400:kworker.0 Request processed in 1320us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.463346:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789597015.463442:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984871808:0@lo:400:kworker.0 00010000:00080000:1.0:1789597015.463634:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb98d4000 x1876527984871680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597015.463830:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.463893:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871808 00000100:00100000:0.0:1789597015.463910:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871808 00000100:00100000:0.0:1789597015.463950:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789597015.463957:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984871808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.464012:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984871808:12345-0@lo:400:kworker.0 Request processed in 55us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.464018:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789597015.464052:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984871808:0@lo:400:kworker.0 00000100:00100000:1.0:1789597015.464169:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984871680:0@lo:400:kworker.0 00010000:00010000:3.0:1789597015.465056:0:19383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00080000:1.0:1789597015.465201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597015.465207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789597015.465211:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597015.465218:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1789597015.465222:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789597015.465233:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597015.465260:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb67b4000 x1876527984872064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789597015.465304:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984872320:0@lo:400:kworker.0 00000100:00100000:1.0:1789597015.465371:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597015.465437:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789597015.465443:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984872448:0@lo:400:kworker.0 00000100:00100000:2.0:1789597015.465518:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872320 00000100:00100000:2.0:1789597015.465526:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872320 00000100:00100000:0.0:1789597015.465636:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984871936:0@lo:400:kworker.0 00000100:00100000:2.0:1789597015.465645:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789597015.465654:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984872320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.465789:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597015.465795:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984872320:12345-0@lo:400:kworker.0 Request processed in 143us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.465802:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789597015.465807:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597015.465812:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984872192:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.465832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.465859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984872064:0@lo:8:kworker.0 00000100:00100000:0.0:1789597015.465894:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597015.465906:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872192 00000100:00100000:2.0:1789597015.465911:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872192 00000100:00080000:0.0:1789597015.465921:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597015.465932:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789597015.465933:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984871936 00000100:00100000:0.0:1789597015.465936:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984871936 00000100:00100000:2.0:1789597015.465938:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984872192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.465963:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872064 00000100:00100000:0.0:1789597015.465967:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872064 00000100:00100000:2.0:1789597015.465979:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984872192:12345-0@lo:400:kworker.0 Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.465981:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789597015.465985:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789597015.465986:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984871936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.466015:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984871936:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.466020:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789597015.466031:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789597015.466035:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984872064:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789597015.466173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789597015.466214:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b5500 x1876527984872320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597015.466227:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984872320:0@lo:400:kworker.0 00000100:00100000:2.0:1789597015.466271:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872448 00000100:00100000:2.0:1789597015.466275:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872448 00000100:00100000:2.0:1789597015.466301:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789597015.466307:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984872448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597015.466348:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984872448:12345-0@lo:400:kworker.0 Request processed in 42us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.466354:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789597015.466623:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b6300 x1876527984872448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597015.466632:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984872448:0@lo:400:kworker.0 00000020:00000080:3.0:1789597015.466917:0:19383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789597015.466962:0:19383:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789597015.466976:0:19383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7b5398e289bbfe20 00000100:00080000:3.0:1789597015.466983:0:19383:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789597015.466992:0:19383:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c7d83f21800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597015.467019:0:19383:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83efb100 x1876527984872576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597015.467039:0:19383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789597015.467186:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984872064:12345-0@lo:8:kworker.0 Request processed in 1148us (1289us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789597015.467201:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789597015.467233:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597015.467237:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789597015.467363:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb67b7100 x1876527984872192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597015.467374:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984872192:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.467385:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984871936:0@lo:400:kworker.0 00000100:00100000:0.0:1789597015.467412:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984872576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789597015.467445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.467495:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789597015.467503:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789597015.467507:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789597015.467511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984872064:0@lo:8:kworker.0 00000100:00100000:0.0:1789597015.467532:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872576 00000100:00100000:0.0:1789597015.467536:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872576 00000100:00100000:0.0:1789597015.467572:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789597015.467578:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984872576:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789597015.467600:0:17048:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:0.0:1789597015.467628:0:17048:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7b5398e289bbfe27 00000004:00100000:0.0:1789597015.467764:0:17048:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789597015.467799:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7d84675000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597015.467848:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876527984872576:12345-0@lo:38:llog_process_th.0 Request processed in 269us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597015.467856:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789597015.467911:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d83efb100 x1876527984872576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597015.467922:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789597015.467928:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789597015.467938:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789597015.467943:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789597015.467945:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f21800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789597015.467949:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984872576:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789597015.469567:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789597015.469914:0:19370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789597015.469940:0:19370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789597015.469954:0:19370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.469966:0:19370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789597015.470009:0:19370:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789597015.470011:0:19370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789597015.470012:0:19370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789597015.470013:0:19370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789597015.470014:0:19370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789597015.470016:0:19370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789597015.470017:0:19370:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789597015.470020:0:19370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789597015.470021:0:19370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789597015.470025:0:19370:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789597015.470027:0:19370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789597015.470028:0:19370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789597015.470029:0:19370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789597015.470030:0:19370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789597015.470031:0:19370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789597015.470033:0:19370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789597015.470038:0:19370:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789597015.470039:0:19370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789597015.470040:0:19370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789597015.470075:0:19370:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789597015.470093:0:19370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984872704:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789597015.470153:0:19370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.470185:0:19370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83dc1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789597015.470335:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872704 00000100:00100000:1.0:1789597015.470342:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872704 00000100:00100000:1.0:1789597015.470415:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789597015.470425:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984872704:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789597015.470466:0:17039:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789597015.470481:0:17039:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789597015.479435:0:17039:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789597015.479462:0:17039:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789597015.479797:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:19370:x1876527984872704:12345-0@lo:253:mount.lustre.0 Request processed in 9367us (9637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.479812:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789597015.479827:0:19370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f66223a4-de53-4574-9339-460f93dd2c76:19370:1876527984872704:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789597015.479842:0:19370:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789597015.479845:0:19370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789597015.479847:0:19370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789597015.479848:0:19370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597015.479849:0:19370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597015.479850:0:19370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597015.479851:0:19370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597015.479853:0:19370:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789597015.479855:0:19370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597015.479856:0:19370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789597015.479897:0:19370:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789597015.480600:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789597015.480606:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789597015.480634:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.480654:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.480692:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.480700:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.480741:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.480758:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 23 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597015.480774:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984872832:0@lo:104: 00000100:00100000:0.0:1789597015.480833:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597015.480871:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872832 00000100:00100000:2.0:1789597015.480879:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872832 00000100:00100000:2.0:1789597015.480918:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597015.480926:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984872832:12345-0@lo:104: 00010000:00010000:2.0:1789597015.480939:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.480982:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789597015.480987:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984872832:12345-0@lo:104: Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.480993:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789597015.481013:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597015.481020:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.481032:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.481035:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dde00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597015.481040:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.481049:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.481050:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597015.481059:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984872960:0@lo:104: 00000100:00100000:0.0:1789597015.481082:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597015.481098:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789597015.481114:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984872832:0@lo:104: 00000001:00000004:0.0:1789597015.482745:0:19370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 10000000:00010000:2.0:1789597015.482903:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597015.482912:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789597015.482957:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.482964:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597015.482990:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.482998:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dde00/0x7b5398e289bbfce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfcec expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.483012:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597015.483014:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597015.483016:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597015.483032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984873088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597015.483098:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597015.483168:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873088 00000100:00100000:2.0:1789597015.483176:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873088 00010000:00010000:2.0:1789597015.483208:0:18581:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 24 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597015.483250:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597015.483259:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f66223a4-de53-4574-9339-460f93dd2c76+24:3644:x1876527984873088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597015.483275:0:18581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597015.483281:0:18581:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 24 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.483294:0:18581:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 24 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.483310:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dca00/0x7b5398e289bbfcec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfce5 expref: 24 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.483324:0:18581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597015.483357:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f66223a4-de53-4574-9339-460f93dd2c76+23:3644:x1876527984873088:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.483364:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597015.483406:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984873088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597015.483431:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984872960 00000100:00100000:2.0:1789597015.483435:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984872960 00000100:00100000:2.0:1789597015.483474:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597015.483481:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984872960:12345-0@lo:104: 00010000:00010000:2.0:1789597015.483491:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.483533:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789597015.483540:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:17063:x1876527984872960:12345-0@lo:104: Request processed in 59us (2456us total) trans 0 rc 0/0 00002000:00080000:0.0:1789597015.486971:0:19370:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789597015.486979:0:19370:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789597015.487023:0:19370:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789597015.487077:0:19370:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789597015.487099:0:19370:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789597015.487120:0:19370:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000100:00100000:2.0:1789597015.487155:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597015.487227:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1876527984872960:0@lo:104: 00010000:00010000:2.0:1789597015.487256:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.487280:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597015.487286:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.487294:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597015.487298:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.487307:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597015.487315:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597015.487322:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789597015.487369:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.487376:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597015.487396:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.487404:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dda00/0x7b5398e289bbfcd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfcde expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.487436:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597015.487439:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597015.487440:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597015.487486:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984873216:0@lo:103:ldlm_bl.0 00000020:00000004:0.0:1789597015.488422:0:19370:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789597015.488674:0:19370:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789597015.488840:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597015.488939:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873216 00000100:00100000:2.0:1789597015.488947:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873216 00010000:00010000:2.0:1789597015.488980:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597015.489585:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597015.489596:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f66223a4-de53-4574-9339-460f93dd2c76+23:3645:x1876527984873216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597015.489615:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597015.489622:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.489648:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.489668:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743600/0x7b5398e289bbfcde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfcd7 expref: 23 pid: 17041 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490816:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490831:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789597015.490852:0:17032:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010245865s 00010000:00010000:2.0:1789597015.490881:0:17032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490888:0:17032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490894:0:17032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490900:0:17032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490907:0:17032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597015.490911:0:17032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490918:0:17032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490933:0:17032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597015.490945:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597015.491026:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f66223a4-de53-4574-9339-460f93dd2c76+22:3645:x1876527984873216:12345-0@lo:103:ldlm_bl.0 Request processed in 1430us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597015.491035:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597015.491119:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984873216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789597015.491465:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.491474:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597015.491481:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742200/0x7b5398e289bbfe2e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597016.381555:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789597016.835056:0:19437:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597016.835326:0:19437:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789597017.023660:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984873344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789597017.023761:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597017.023900:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873344 00000100:00100000:0.0:1789597017.023910:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873344 00000100:00100000:0.0:1789597017.023982:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597017.023993:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984873344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789597017.024037:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597017.024087:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984873344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597017.024093:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597017.024147:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984873344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789597017.024329:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1789597017.405342:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789597017.405352:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d8318b800 from 10 10000000:01000000:2.0:1789597017.405359:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789597017.405429:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.405444:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.405457:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597017.405490:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789597017.405572:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597017.405720:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825480c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789597017.406234:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597017.406464:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873472 00000100:00100000:3.0:1789597017.406475:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873472 00000100:00100000:3.0:1789597017.406587:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789597017.406599:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984873472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597017.406617:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597017.406635:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfe3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfe35 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597017.406665:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfe3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfe35 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597017.406709:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfe3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfe35 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597017.406720:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e81511400, rc 0) 00000100:00100000:3.0:1789597017.406787:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984873472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597017.406793:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789597017.406899:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597017.406919:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.406928:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597017.407009:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789597017.407045:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597017.418905:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873600 00000100:00100000:0.0:1789597017.418924:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873600 00000100:00100000:0.0:1789597017.418975:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597017.419047:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789597017.419058:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984873600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789597017.419085:0:17040:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789597017.419116:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789597017.419119:0:17040:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789597017.419271:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984873600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 214us (12224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597017.419279:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789597017.419407:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789597017.419500:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789597017.419512:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.419533:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597017.419545:0:17043:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789597017.419548:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7ebfae6000 from 10 10000000:01000000:2.0:1789597017.419551:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789597017.419588:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.419596:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.419605:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597017.419625:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789597017.419658:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597017.419709:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597017.419908:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873728 00000100:00100000:0.0:1789597017.419914:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873728 00000100:00100000:0.0:1789597017.419937:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789597017.419944:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984873728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597017.419956:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597017.419972:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742800/0x7b5398e289bbfe4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbfe43 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597017.419996:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742800/0x7b5398e289bbfe4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbfe43 expref: 24 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597017.420018:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742800/0x7b5398e289bbfe4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfe43 expref: 24 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597017.420027:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742800, rc 0) 00000100:00100000:0.0:1789597017.420065:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984873728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597017.420072:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789597017.423160:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597017.423199:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.423216:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597017.423481:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789597017.423570:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597017.423629:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597017.423940:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873856 00000100:00100000:3.0:1789597017.423949:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873856 00000100:00100000:3.0:1789597017.424002:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789597017.424012:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984873856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789597017.424038:0:17041:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789597017.424060:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789597017.424063:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789597017.424173:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984873856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597017.424180:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789597017.425610:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984873856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789597017.425737:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789597017.425750:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597017.425764:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597018.434803:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597019.069606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984873984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597019.069736:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597019.069803:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984874112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597019.069844:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597019.069889:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984873984 00000100:00100000:3.0:1789597019.069898:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984873984 00000100:00100000:2.0:1789597019.075768:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874112 00000100:00100000:2.0:1789597019.075791:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874112 00000100:00100000:2.0:1789597019.076051:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597019.076065:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984874112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597019.076112:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597019.076224:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984874112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (6393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597019.076232:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597019.076276:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984874240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789597019.076322:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789597019.076600:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597019.076733:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874240 00000100:00100000:1.0:1789597019.076739:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874240 00000100:00100000:3.0:1789597019.081165:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984874112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597019.081227:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789597019.081244:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984873984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789597019.081299:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789597019.081415:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984873984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 178us (11678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597019.081423:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789597019.082481:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789597019.082499:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984874240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597019.082534:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597019.082621:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984874240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (6298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597019.082628:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789597019.082902:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984874240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789597019.083109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984873984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789597019.457145:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789597020.160433:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789597020.480632:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789597020.610333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597020.610342:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597020.610348:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597020.610374:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7eb66aa000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597020.610403:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83dec380 x1876527984874752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789597020.610439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597020.610452:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597020.610454:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597020.610461:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7e859ea000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597020.610473:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d83def480 x1876527984875264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597020.610712:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984874624:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611163:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984874368:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611226:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.611278:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984875008:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611304:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.611323:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984875648:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611345:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.611370:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789597020.611376:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984874496:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.611418:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984875136:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611440:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.611454:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984875776:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.611477:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.611522:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875008 00000100:00100000:2.0:1789597020.611533:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875008 00000100:00100000:3.0:1789597020.611628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597020.611649:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984875392:0@lo:400:kworker.0 00000100:00100000:3.0:1789597020.611669:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597020.611709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984875904:0@lo:400:kworker.0 00000100:00100000:3.0:1789597020.611733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597020.611860:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874496 00000100:00100000:1.0:1789597020.611866:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874496 00000100:00100000:1.0:1789597020.611930:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789597020.611940:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984874496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597020.612629:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789597020.612641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984874880:0@lo:400:kworker.0 00000100:00100000:3.0:1789597020.612714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597020.612732:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984875520:0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.612897:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984874752:0@lo:8:kworker.0 00000100:00100000:0.0:1789597020.612934:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597020.612957:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984875264:0@lo:8:kworker.0 00000100:00100000:0.0:1789597020.612977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597020.613026:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875648 00000100:00100000:0.0:1789597020.613032:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875648 00000100:00100000:0.0:1789597020.613086:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875776 00000100:00100000:0.0:1789597020.613090:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875776 00000100:00100000:0.0:1789597020.613104:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875392 00000100:00100000:0.0:1789597020.613107:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875392 00000100:00100000:0.0:1789597020.613119:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875904 00000100:00100000:0.0:1789597020.613121:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875904 00000100:00100000:0.0:1789597020.613133:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874880 00000100:00100000:0.0:1789597020.613135:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874880 00000100:00100000:0.0:1789597020.613151:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789597020.613157:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984875648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597020.613264:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984874496:12345-0@lo:400:kworker.0 Request processed in 1324us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597020.613273:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789597020.613406:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789597020.613414:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984875008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597020.613509:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597020.613565:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874368 00000100:00100000:3.0:1789597020.613570:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874368 00000100:00100000:3.0:1789597020.613605:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789597020.613613:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984874368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.615594:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984875648:12345-0@lo:400:kworker.0 Request processed in 2424us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.615631:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789597020.615668:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875520 00000100:00100000:0.0:1789597020.615691:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875520 00000100:00100000:0.0:1789597020.615728:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789597020.615735:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984875776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.619332:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984875776:12345-0@lo:400:kworker.0 Request processed in 3584us (7841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.619348:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789597020.619391:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789597020.619404:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984875392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.619465:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984875392:12345-0@lo:400:kworker.0 Request processed in 65us (7794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.619471:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789597020.619485:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789597020.619494:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984875904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.619557:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984875904:12345-0@lo:400:kworker.0 Request processed in 64us (7822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.619563:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789597020.619577:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789597020.619584:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984874880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.619614:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984874880:12345-0@lo:400:kworker.0 Request processed in 31us (6901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.619619:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789597020.619631:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789597020.619638:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984875520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.619708:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984875520:12345-0@lo:400:kworker.0 Request processed in 71us (6198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.619715:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789597020.619920:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875136 00000100:00100000:0.0:1789597020.619930:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875136 00000100:00100000:0.0:1789597020.619967:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874624 00000100:00100000:0.0:1789597020.619970:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874624 00000100:00100000:0.0:1789597020.619988:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984874752 00000100:00100000:0.0:1789597020.619991:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984874752 00000100:00100000:0.0:1789597020.619999:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984875264 00000100:00100000:0.0:1789597020.620014:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984875264 00000100:00100000:0.0:1789597020.620025:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789597020.620031:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984875136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.620071:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984875136:12345-0@lo:400:kworker.0 Request processed in 40us (8630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.620076:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789597020.620088:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597020.620094:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984874624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.620142:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984874624:12345-0@lo:400:kworker.0 Request processed in 48us (8514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.620148:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597020.620158:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789597020.620162:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984874752:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789597020.620193:0:18554:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:0.0:1789597020.620227:0:18554:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bbfe51 00002000:00100000:0.0:1789597020.620243:0:18554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c7d84671800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789597020.620247:0:18554:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789597020.620256:0:18554:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789597020.620440:0:18554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789597020.620467:0:18554:0:(import.c:65:import_set_state_nolock()) ffff9c7d84674000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597020.620531:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984874752:12345-0@lo:8:kworker.0 Request processed in 367us (7596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.620930:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789597020.620948:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789597020.620954:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984875264:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789597020.620971:0:18554:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:0.0:1789597020.620990:0:18554:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bbfe58 00002000:00100000:0.0:1789597020.621078:0:18554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c7d84675800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789597020.621084:0:18554:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789597020.621086:0:18554:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789597020.621115:0:18554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789597020.621131:0:18554:0:(import.c:65:import_set_state_nolock()) ffff9c7d84677800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597020.621164:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984875264:12345-0@lo:8:kworker.0 Request processed in 210us (8186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.621171:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789597020.621227:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789597020.621231:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597020.621234:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789597020.621292:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dee300 x1876527984874880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597020.621310:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984874880:0@lo:400:kworker.0 00010000:00080000:0.0:1789597020.621326:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442df80 x1876527984875520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597020.621350:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984875520:0@lo:400:kworker.0 00010000:00080000:0.0:1789597020.621365:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e79500 x1876527984875904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597020.621374:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984875904:0@lo:400:kworker.0 00000100:00100000:0.0:1789597020.621386:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984874624:0@lo:400:kworker.0 00010000:00080000:0.0:1789597020.621399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb98d4000 x1876527984875392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597020.621407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984875392:0@lo:400:kworker.0 00010000:00080000:0.0:1789597020.621449:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dec380 x1876527984874752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789597020.621462:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789597020.621471:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789597020.621477:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789597020.621480:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789597020.621636:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789597020.621642:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984874752:0@lo:8:kworker.0 00010000:00080000:0.0:1789597020.621658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83def480 x1876527984875264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789597020.621668:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789597020.621673:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789597020.621694:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789597020.621697:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789597020.621716:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789597020.621720:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984875264:0@lo:8:kworker.0 00000004:00080000:0.0:1789597020.621774:0:17792:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789597020.621796:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17792:1876527984876160:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789597020.621842:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597020.621862:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ead4b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1789597020.621877:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984876032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789597020.621901:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597020.621931:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876032 00000100:00100000:0.0:1789597020.621936:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876032 00000100:00100000:0.0:1789597020.621973:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789597020.621979:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984876032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789597020.622000:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789597020.622110:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984874496:0@lo:400:kworker.0 00000004:00080000:1.0:1789597020.622124:0:17073:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789597020.622201:0:17073:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 595440521929ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789597020.622208:0:17073:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789597020.622258:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984875136:0@lo:400:kworker.0 00010000:00080000:1.0:1789597020.622274:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e79880 x1876527984875776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597020.622283:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984875776:0@lo:400:kworker.0 00000100:00100000:2.0:1789597020.622351:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984875008:12345-0@lo:400:kworker.0 Request processed in 8936us (11043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597020.622360:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1789597020.622410:0:17074:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789597020.622424:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1876527984876416:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789597020.622452:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.622466:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82548780 going to sleep for 11 seconds 00000100:00100000:2.0:1789597020.622478:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597020.622485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984876288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597020.622503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597020.622646:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984876032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 667us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.622653:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789597020.622664:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876288 00000100:00100000:0.0:1789597020.622667:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876288 00000100:00100000:0.0:1789597020.622705:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789597020.622711:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984876288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789597020.622723:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789597020.622749:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984876288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.622755:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789597020.622924:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c17480 x1876527984876288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597020.622951:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984876288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789597020.622972:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876160 00000100:00100000:0.0:1789597020.622976:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876160 00000100:00100000:0.0:1789597020.622995:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876416 00000100:00100000:0.0:1789597020.622997:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876416 00000100:00100000:0.0:1789597020.628845:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789597020.628865:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17792:x1876527984876160:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789597020.629240:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789597020.629249:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17074:x1876527984876416:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1789597020.629295:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789597020.629349:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f4380 x1876527984876032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597020.629375:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984876032:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789597020.630500:0:17026:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789597020.631729:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984874368:12345-0@lo:400:kworker.0 Request processed in 18107us (20493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597020.631746:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:3.0:1789597020.631824:0:17791:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789597020.631923:0:17791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595450243861ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789597020.631931:0:17791:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789597020.632947:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984874368:0@lo:400:kworker.0 00000100:00100000:1.0:1789597020.632992:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984875008:0@lo:400:kworker.0 00010000:00080000:1.0:1789597020.633009:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83e78a80 x1876527984875648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597020.633020:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984875648:0@lo:400:kworker.0 00000004:00080000:3.0:1789597020.635934:0:17780:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789597020.640099:0:18556:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789597020.640115:0:18556:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789597020.640235:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17792:x1876527984876160:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11372us (18388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.640249:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789597020.640349:0:17792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d825f6300 x1876527984876160/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789597036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597020.640367:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17792:1876527984876160:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789597020.640383:0:17792:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789597020.640425:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17792:1876527984876544:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789597020.640462:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597020.640493:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82548cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597020.640810:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876544 00000100:00100000:0.0:1789597020.640827:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876544 00000100:00100000:0.0:1789597020.640880:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789597020.640889:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17792:x1876527984876544:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789597020.640919:0:18557:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789597020.640967:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17792:x1876527984876544:12345-0@lo:5:osp-pre-1-1.0 Request processed in 79us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597020.640992:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789597020.641059:0:17792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c14e00 x1876527984876544/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789597036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597020.641071:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17792:1876527984876544:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789597020.641082:0:17792:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789597020.641114:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17792:1876527984876672:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789597020.641142:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597020.641165:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9187c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789597020.641206:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876672 00000100:00100000:2.0:1789597020.641211:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876672 00000100:00100000:2.0:1789597020.641241:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789597020.641248:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17792:x1876527984876672:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789597020.641273:0:18554:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1789597020.659163:0:19208:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789597020.659182:0:19208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789597020.659193:0:19208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:0.0:1789597020.689915:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.689931:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.689954:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.689960:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.689968:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.689989:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.690001:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.690010:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.690041:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597020.691179:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.691192:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.691204:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.691209:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.691222:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.691252:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.691261:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.691282:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.691285:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.691286:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597020.691970:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597020.692067:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.692082:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789597020.692088:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597020.692095:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.692109:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.692121:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.692131:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.692156:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789597020.694182:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597020.694197:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.694217:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789597020.694222:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597020.694229:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.694245:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.694263:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.694273:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.694299:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789597020.695281:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597020.695297:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695309:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597020.695314:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695340:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695373:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695382:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a198a7f/0x7b5398e289bbfe66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695405:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597020.695409:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695415:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597020.695418:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695424:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695434:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695441:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2cdec3/0x7b5398e289bbfe6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.695464:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.695466:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.695468:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597020.696353:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597020.696366:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.696380:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789597020.696384:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597020.696390:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.696405:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.696414:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.696422:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.696459:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597020.697060:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597020.697067:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.697076:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597020.697081:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.697090:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.697106:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.697113:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000443f916d/0x7b5398e289bbfe74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.697132:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.697134:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.697135:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.697922:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597020.700598:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597020.700618:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.700643:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789597020.700648:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597020.700656:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.700706:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.700718:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.700726:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.700758:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597020.701443:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597020.701457:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.701485:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597020.701491:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.701502:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.701527:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.701549:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb7cb1b3/0x7b5398e289bbfe7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.701583:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.701585:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.701588:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789597020.704033:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.704050:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.704069:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.704075:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.704082:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.704096:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.704114:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.704122:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.704152:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597020.706115:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597020.706134:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.706149:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597020.706153:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.706174:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.706202:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.706210:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfe82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.706240:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.706242:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.706244:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789597020.715806:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.715843:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.715867:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.715872:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.715879:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.715896:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.715906:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.715914:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.715959:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597020.716824:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.716835:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.716849:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.716868:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.716879:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.716906:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.716914:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb988f9/0x7b5398e289bbfe89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.716940:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.716941:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.716943:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789597020.718777:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.718790:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.718825:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.718830:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.718837:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.718854:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.718865:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.718874:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.718901:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597020.719192:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.719199:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.719208:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.719212:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.719222:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.719240:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.719254:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bbfe90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.719273:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.719275:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.719277:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789597020.724319:0:19371:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789597020.724354:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789597020.724359:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789597020.725057:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17792:x1876527984876672:12345-0@lo:5:osp-pre-1-1.0 Request processed in 83801us (83905us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789597020.725071:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00002000:00010000:0.0:1789597020.727447:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.727468:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.727489:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.727511:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.727520:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.727606:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.727622:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.727632:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.727665:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789597020.727973:0:17792:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789597020.727986:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17792:1876527984876672:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789597020.728006:0:17792:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789597020.728073:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17792:1876527984876800:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789597020.728149:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597020.728189:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789597020.728231:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876800 00000100:00100000:1.0:1789597020.728239:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876800 00000100:00100000:1.0:1789597020.728291:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789597020.728301:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17792:x1876527984876800:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789597020.729101:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.729111:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.729124:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.729129:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.729135:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.729149:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.729159:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.729175:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.729199:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789597020.729530:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17792:x1876527984876800:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1225us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597020.729611:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789597020.729669:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597020.729692:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729708:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.729713:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729725:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729744:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729753:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f237583/0x7b5398e289bbfe97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729773:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.729776:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729783:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.729787:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.729909:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.729941:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729955:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729969:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003905ac4e/0x7b5398e289bbfe9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.729984:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.729986:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.729987:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1789597020.730030:0:17792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b6300 x1876527984876800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789597036 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597020.730046:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17792:1876527984876800:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789597020.730212:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.730220:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730229:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.730232:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.730237:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730247:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730256:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730263:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730315:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789597020.730705:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.730712:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730726:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.730729:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.730733:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730743:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730751:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.730758:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730896:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597020.730903:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730912:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597020.730915:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730924:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730936:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730943:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d01bee4/0x7b5398e289bbfea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730958:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597020.730960:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730966:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597020.730970:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730977:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730992:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.730999:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.731001:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.731003:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.731061:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597020.731066:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000341e9aa3/0x7b5398e289bbfeac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789597020.731371:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.731377:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.731386:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.731389:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.731393:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.731412:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.731421:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.731429:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.731495:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.731501:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.731509:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.731513:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.731521:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.731533:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.731541:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.731543:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.731550:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.731617:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597020.731622:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000481d8e35/0x7b5398e289bbfeb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789597020.732037:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.732043:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732052:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.732055:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.732060:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732070:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732090:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732097:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.732187:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597020.732194:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.732202:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597020.732205:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.732213:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.732225:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.732234:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.732236:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.732238:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.732304:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597020.732309:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edef8a07/0x7b5398e289bbfeba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789597020.732655:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.732661:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732670:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.732674:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.732708:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732718:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732725:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.732745:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.734477:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.734494:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.734508:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.734514:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.734526:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.734548:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.734562:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.734564:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.734566:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.734673:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597020.734695:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af7ee45/0x7b5398e289bbfec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.734790:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597020.735476:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597020.735485:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.735511:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789597020.735516:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597020.735523:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.735539:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.735548:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.735555:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.735618:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789597020.736018:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597020.736024:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.736033:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789597020.736036:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597020.736040:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.736050:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.736070:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597020.736078:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736187:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597020.736196:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736206:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.736211:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736223:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736246:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736255:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bbfec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736274:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.736278:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736285:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.736289:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736297:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736307:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.736315:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.736316:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.736318:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597020.736424:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789597020.736430:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bbfecf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789597020.736909:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.736917:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.736926:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.736930:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.736934:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.736946:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.736955:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.736962:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.740554:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.740576:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.740606:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.740614:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.740628:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.740654:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.740882:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.740886:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.740889:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.743459:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597020.743474:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f947a6/0x7b5398e289bbfed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.744033:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789597020.744152:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.744160:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.744174:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.744179:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.744185:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.744202:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.744213:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.744222:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.745984:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789597020.746493:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597020.746503:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.746527:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789597020.746531:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597020.746537:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.746554:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.746566:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.746574:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.748925:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597020.748946:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.748962:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.748969:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.748982:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749007:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749035:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009556268d/0x7b5398e289bbfedd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749065:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.749070:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749075:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.749079:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749087:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749097:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.749104:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.749105:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.749107:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.750173:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597020.750187:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bbfee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597020.752812:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.752837:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.752854:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.752859:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.752866:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.752883:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.752907:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.752915:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.753491:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.753502:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.753514:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.753527:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.753538:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.753559:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.755469:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.755477:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.755480:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.759702:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597020.759722:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfeeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.759742:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597020.761774:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.761786:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.761800:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.761805:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.761811:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.761836:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.761847:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.761865:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.761887:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597020.762116:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597020.762125:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.762137:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597020.762149:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.762162:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.762183:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.762193:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1bb85a2/0x7b5398e289bbfef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.762211:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.762213:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.762215:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597020.766066:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.766083:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766102:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.766108:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.766116:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766131:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766141:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766150:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766167:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597020.766659:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.766674:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.766706:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.766711:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.766721:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.766743:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.766751:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb23353f/0x7b5398e289bbfef9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597020.766788:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597020.766792:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.766796:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.766797:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.766798:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597020.766825:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.766829:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.766834:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766845:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766852:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766858:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.766877:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597020.767412:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597020.767420:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.767430:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597020.767434:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.767443:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.767457:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.767474:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c026bda3/0x7b5398e289bbff00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.767492:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.767493:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.767495:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597020.770916:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.770934:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.770961:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.770966:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.770973:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.770989:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.771016:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.771024:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.771055:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597020.771131:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.771140:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.771151:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.771157:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.771168:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.771190:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.771197:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071f11f56/0x7b5398e289bbff07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.771221:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.771223:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.771225:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597020.772774:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.772793:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.772811:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.772824:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.772830:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.772843:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.772853:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.772861:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.772906:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597020.773068:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597020.773077:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.773086:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597020.773091:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.773100:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.773117:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.773124:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d75610bf/0x7b5398e289bbff0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.773147:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.773149:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.773150:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597020.774838:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.774856:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.774874:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.774879:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.774885:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.774899:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.774910:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.774917:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.777709:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597020.778480:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597020.778491:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.778521:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597020.778527:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.778539:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.778566:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.778575:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000394baa16/0x7b5398e289bbff15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597020.778599:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.778601:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597020.778603:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597020.779110:0:19208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597020.779121:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.779134:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789597020.779145:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597020.779152:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.779167:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.779177:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.779185:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597020.779210:0:19208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789597020.779281:0:19208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:0.0:1789597020.779354:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597020.779361:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.779372:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597020.779377:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.779386:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597020.779394:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17074:x1876527984876416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 150141us (156936us total) trans 0 rc 0/0 00010000:00010000:0.0:1789597020.779403:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597020.779409:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789597020.779418:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e117cc7/0x7b5398e289bbff1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597020.779438:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.779440:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597020.779441:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597020.779574:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1876527984876416:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789597020.779595:0:17074:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789597020.779655:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1876527984876928:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789597020.779728:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597020.779759:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789597020.780217:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984876928 00000100:00100000:3.0:1789597020.780226:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984876928 00000100:00100000:3.0:1789597020.780282:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789597020.780291:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17074:x1876527984876928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789597020.780334:0:18557:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1789597020.793567:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17074:x1876527984876928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13266us (13828us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789597020.793582:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789597020.793774:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1876527984876928:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789597020.793795:0:17074:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1789597021.501711:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597022.141125:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984877056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789597022.141201:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597022.146154:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877056 00000100:00100000:0.0:1789597022.146175:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877056 00000100:00100000:0.0:1789597022.146371:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789597022.146382:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984877056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789597022.146416:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1789597022.146471:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597022.146516:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984877056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597022.146524:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789597022.149602:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984877056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789597022.524886:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789597023.049883:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789597023.551717:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597024.189369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984877184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597024.189455:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597024.189524:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597024.189531:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984877312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597024.189557:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597024.189639:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877184 00000100:00100000:1.0:1789597024.189649:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877184 00000100:00100000:1.0:1789597024.189734:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789597024.189744:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984877184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597024.189799:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789597024.189860:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984877184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597024.189867:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789597024.190342:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984877184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597024.190389:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877312 00000100:00100000:0.0:1789597024.190393:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877312 00000100:00100000:0.0:1789597024.190430:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789597024.190438:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984877312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597024.190462:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597024.190503:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984877312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597024.190509:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789597024.190526:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597024.190552:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984877312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597024.191583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984877440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597024.191635:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597024.191747:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877440 00000100:00100000:1.0:1789597024.191755:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877440 00000100:00100000:1.0:1789597024.191812:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789597024.191821:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984877440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597024.191856:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597024.196570:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984877440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4738us (4922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597024.196587:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789597024.196740:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984877440:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1789597024.504850:0:19727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789597024.574954:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789597025.463361:0:19779:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597025.463573:0:19779:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789597025.597493:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597025.724957:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984877952:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725042:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725098:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984878464:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725122:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725138:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984878976:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725158:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725185:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789597025.725190:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984877568:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725217:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725253:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984878080:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725275:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725306:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984878592:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725328:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725347:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984879104:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725370:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725399:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984877696:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725429:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725449:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984878208:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725468:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725484:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984878720:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725502:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725513:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789597025.725518:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984877824:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725535:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725566:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984878336:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725586:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984878848:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597025.725651:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877952 00000100:00100000:2.0:1789597025.725662:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877952 00000100:00100000:2.0:1789597025.725753:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878464 00000100:00100000:2.0:1789597025.725757:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878464 00000100:00100000:2.0:1789597025.725783:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877824 00000100:00100000:2.0:1789597025.725786:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877824 00000100:00100000:2.0:1789597025.725801:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878336 00000100:00100000:2.0:1789597025.725809:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878336 00000100:00100000:2.0:1789597025.725827:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597025.725836:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984877952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725895:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984877952:12345-0@lo:400:kworker.0 Request processed in 60us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.725903:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597025.725920:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597025.725926:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984878464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725950:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984878464:12345-0@lo:400:kworker.0 Request processed in 24us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.725956:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597025.725966:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597025.725971:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984877824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.725998:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984877824:12345-0@lo:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726003:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597025.726013:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597025.726018:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984878336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726040:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984878336:12345-0@lo:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726046:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597025.726063:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878976 00000100:00100000:2.0:1789597025.726067:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878976 00000100:00100000:2.0:1789597025.726087:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878080 00000100:00100000:2.0:1789597025.726090:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878080 00000100:00100000:2.0:1789597025.726099:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878592 00000100:00100000:2.0:1789597025.726102:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878592 00000100:00100000:2.0:1789597025.726124:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879104 00000100:00100000:2.0:1789597025.726126:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879104 00000100:00100000:2.0:1789597025.726138:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878720 00000100:00100000:2.0:1789597025.726140:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878720 00000100:00100000:2.0:1789597025.726152:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878848 00000100:00100000:2.0:1789597025.726154:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878848 00000100:00100000:2.0:1789597025.726167:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789597025.726173:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984878976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726204:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984878976:12345-0@lo:400:kworker.0 Request processed in 30us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726210:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789597025.726221:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789597025.726226:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984878080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726252:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984878080:12345-0@lo:400:kworker.0 Request processed in 26us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726258:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789597025.726267:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789597025.726272:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984878592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726298:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984878592:12345-0@lo:400:kworker.0 Request processed in 25us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726303:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789597025.726315:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789597025.726320:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984879104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726346:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984879104:12345-0@lo:400:kworker.0 Request processed in 27us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726352:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789597025.726362:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789597025.726374:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984878720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726405:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984878720:12345-0@lo:400:kworker.0 Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726410:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789597025.726423:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789597025.726428:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984878848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726452:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984878848:12345-0@lo:400:kworker.0 Request processed in 24us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726457:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789597025.726478:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877568 00000100:00100000:2.0:1789597025.726481:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877568 00000100:00100000:2.0:1789597025.726510:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789597025.726517:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984877568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726546:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984877568:12345-0@lo:400:kworker.0 Request processed in 31us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726552:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789597025.726598:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984877696 00000100:00100000:2.0:1789597025.726601:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984877696 00000100:00100000:2.0:1789597025.726629:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984878208 00000100:00100000:2.0:1789597025.726632:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984878208 00000100:00100000:2.0:1789597025.726643:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789597025.726649:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984877696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726714:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984877696:12345-0@lo:400:kworker.0 Request processed in 64us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726720:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789597025.726730:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789597025.726735:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984878208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726767:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984878208:12345-0@lo:400:kworker.0 Request processed in 32us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597025.726785:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789597025.726810:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789597025.726816:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597025.726819:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789597025.726821:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597025.726864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984877824:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726878:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984878336:0@lo:400:kworker.0 00010000:00080000:2.0:1789597025.726891:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c14e00 x1876527984878848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597025.726901:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984878848:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726912:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984877696:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984878208:0@lo:400:kworker.0 00010000:00080000:2.0:1789597025.726932:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c14a80 x1876527984878720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597025.726940:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984878720:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.726988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984877568:0@lo:400:kworker.0 00010000:00080000:2.0:1789597025.727000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c14380 x1876527984878080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597025.727009:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984878080:0@lo:400:kworker.0 00010000:00080000:2.0:1789597025.727020:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c16a00 x1876527984878592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597025.727035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984878592:0@lo:400:kworker.0 00010000:00080000:2.0:1789597025.727048:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83696300 x1876527984879104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597025.727056:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984879104:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.727069:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984877952:0@lo:400:kworker.0 00000100:00100000:2.0:1789597025.727080:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984878464:0@lo:400:kworker.0 00010000:00080000:2.0:1789597025.727091:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb0c17480 x1876527984878976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597025.727099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984878976:0@lo:400:kworker.0 00000100:00100000:3.0:1789597025.730199:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597025.730230:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984879232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597025.730319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597025.730379:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879232 00000100:00100000:3.0:1789597025.730389:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879232 00000100:00100000:3.0:1789597025.730445:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597025.730454:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984879232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789597025.730489:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789597025.730533:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984879232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597025.730540:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597025.730596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984879232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597025.731222:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597025.731239:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984879360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597025.731371:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597025.734413:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879360 00000100:00100000:1.0:1789597025.734429:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879360 00000100:00100000:1.0:1789597025.734530:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597025.734550:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984879360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789597025.734574:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789597025.734674:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984879360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597025.734703:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789597025.734829:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984879360:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1789597026.247100:0:19371:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:1.0:1789597026.419531:0:19830:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789597026.419833:0:19830:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789597026.621021:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597026.737543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.737612:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721472 00000100:00100000:0.0:1789597026.737626:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721472 00000100:00100000:0.0:1789597026.740858:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:0.0:1789597026.740888:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1876527961721472:12345-192.168.202.16@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789597026.740925:0:17041:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1face98e-a79e-4341-9221-d059c3bcf042@192.168.202.16@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1789597026.740966:0:17041:0:(genops.c:1384:class_connect()) connect: client 1face98e-a79e-4341-9221-d059c3bcf042, cookie 0x7b5398e289bbff23 00000100:00080000:0.0:1789597026.741118:0:17041:0:(import.c:65:import_set_state_nolock()) ffff9c7d84670000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597026.741208:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+5:2405:x1876527961721472:12345-192.168.202.16@tcp:250:mount.lustre.0 Request processed in 320us (3677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.741217:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:3.0:1789597026.760603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.760862:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721600 00000100:00100000:2.0:1789597026.760878:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721600 00000100:00100000:2.0:1789597026.760951:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:2.0:1789597026.760964:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+5:14882:x1876527961721600:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789597026.760991:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597026.761018:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbff2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07c9b expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597026.761058:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbff2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c9b expref: 6 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597026.761093:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbff2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c9b expref: 6 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597026.761103:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbe00, rc 0) 00000100:00100000:2.0:1789597026.761181:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+6:14882:x1876527961721600:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 220us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.761188:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:0.0:1789597026.768902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.775876:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721728 00000100:00100000:2.0:1789597026.775911:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721728 00000100:00100000:2.0:1789597026.776015:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789597026.776028:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+6:14882:x1876527961721728:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789597026.776479:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+6:14882:x1876527961721728:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 450us (7585us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789597026.776488:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:1.0:1789597026.783215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.783327:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721856 00000100:00100000:0.0:1789597026.783339:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721856 00000100:00100000:0.0:1789597026.783413:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:0.0:1789597026.783426:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+6:14882:x1876527961721856:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789597026.783445:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597026.783466:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4e00/0x7b5398e289bbff31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ca2 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597026.783497:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4e00/0x7b5398e289bbff31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ca2 expref: 7 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597026.783508:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4e00/0x7b5398e289bbff31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ca2 expref: 7 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597026.783518:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4e00, rc 0) 00000100:00100000:0.0:1789597026.783586:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+7:14882:x1876527961721856:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 164us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.783594:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1789597026.785879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.786043:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961721984 00000100:00100000:2.0:1789597026.786058:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961721984 00000100:00100000:2.0:1789597026.786124:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:2.0:1789597026.786135:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+7:14882:x1876527961721984:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789597026.786527:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+8:14882:x1876527961721984:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 393us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.786536:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1789597026.790163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597026.790331:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722112 00000100:00100000:3.0:1789597026.790356:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722112 00000100:00100000:3.0:1789597026.790433:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:3.0:1789597026.790445:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+8:14882:x1876527961722112:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789597026.790644:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+8:14882:x1876527961722112:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 199us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597026.790652:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:1.0:1789597026.793757:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.793984:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722240 00000100:00100000:2.0:1789597026.793996:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722240 00000100:00100000:2.0:1789597026.794048:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:2.0:1789597026.794058:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+8:14900:x1876527961722240:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789597026.794215:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+8:14900:x1876527961722240:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 158us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.794223:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:1.0:1789597026.827486:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.828950:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722368 00000100:00100000:0.0:1789597026.828996:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722368 00000100:00100000:0.0:1789597026.829094:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:0.0:1789597026.829108:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+8:14900:x1876527961722368:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789597026.829319:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+8:14900:x1876527961722368:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 213us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.829329:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:1.0:1789597026.838660:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597026.839142:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722496 00000100:00100000:3.0:1789597026.839161:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722496 00000100:00100000:3.0:1789597026.839242:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:3.0:1789597026.839258:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+8:14900:x1876527961722496:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597026.839538:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+8:14900:x1876527961722496:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 277us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597026.839548:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:1.0:1789597026.845402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.846751:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722624 00000100:00100000:0.0:1789597026.846780:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722624 00000100:00100000:0.0:1789597026.846858:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1789597026.846869:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8441dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+8:14882:x1876527961722624:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789597026.846890:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597026.846911:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4800/0x7b5398e289bbff38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07cd3 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597026.846942:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4800/0x7b5398e289bbff38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cd3 expref: 9 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597026.846953:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4800/0x7b5398e289bbff38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cd3 expref: 9 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597026.846962:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4800, rc 0) 00000100:00100000:0.0:1789597026.847045:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8441dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+9:14882:x1876527961722624:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 177us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.847052:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:1.0:1789597026.851966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597026.852084:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722752 00000100:00100000:3.0:1789597026.852099:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722752 00000100:00100000:3.0:1789597026.852187:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:3.0:1789597026.852200:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+9:14882:x1876527961722752:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789597026.852237:0:17040:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789597026.852271:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789597026.852276:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789597026.852280:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789597026.852926:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789597026.852930:0:17040:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789597026.856211:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+9:14882:x1876527961722752:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 3995us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597026.856514:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:1.0:1789597026.861167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.861382:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961722880 00000100:00100000:2.0:1789597026.861398:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961722880 00000100:00100000:2.0:1789597026.861480:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:2.0:1789597026.861493:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+9:14882:x1876527961722880:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789597026.861518:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597026.861992:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07cda expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597026.862039:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 10 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597026.862056:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 10 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597026.862067:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db600, rc 0) 00000100:00100000:2.0:1789597026.862204:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+10:14882:x1876527961722880:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 712us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.862213:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:0.0:1789597026.865075:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597026.865196:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723008 00000100:00100000:3.0:1789597026.865211:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723008 00000100:00100000:3.0:1789597026.865394:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:3.0:1789597026.865409:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+10:14882:x1876527961723008:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789597026.865673:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+10:14882:x1876527961723008:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 266us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597026.865724:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:1.0:1789597026.868179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.868374:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723136 00000100:00100000:2.0:1789597026.868390:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723136 00000100:00100000:2.0:1789597026.868467:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:2.0:1789597026.868481:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+10:14882:x1876527961723136:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789597026.868948:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+10:14882:x1876527961723136:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 467us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.868966:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:1.0:1789597026.872899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597026.873078:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723264 00000100:00100000:3.0:1789597026.873096:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723264 00000100:00100000:3.0:1789597026.873211:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1789597026.873242:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+10:14905:x1876527961723264:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597026.873538:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+10:14905:x1876527961723264:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 292us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597026.873549:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:0.0:1789597026.879254:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.879397:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723392 00000100:00100000:2.0:1789597026.879414:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723392 00000100:00100000:2.0:1789597026.879493:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:2.0:1789597026.879506:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+10:14905:x1876527961723392:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789597026.886241:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+10:14905:x1876527961723392:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 6713us (6978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.886264:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:1.0:1789597026.903165:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597026.903310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.903960:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723520 00000100:00100000:0.0:1789597026.904003:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723520 00000100:00100000:0.0:1789597026.904077:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723776 00000100:00100000:0.0:1789597026.904081:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723776 00000100:00100000:0.0:1789597026.904120:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789597026.904133:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1876527961723520:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789597026.904183:0:18445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7aa843d4-eae2-4ed1-be92-0aea9eabc166@192.168.202.16@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1789597026.904278:0:18445:0:(genops.c:1384:class_connect()) connect: client 7aa843d4-eae2-4ed1-be92-0aea9eabc166, cookie 0x7b5398e289bbff46 00000004:00100000:0.0:1789597026.904340:0:18445:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789597026.904751:0:18445:0:(import.c:65:import_set_state_nolock()) ffff9c7d84676000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597026.904871:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2405:x1876527961723520:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 737us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.904881:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789597026.904907:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789597026.904912:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1876527961723776:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789597026.904933:0:18445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7aa843d4-eae2-4ed1-be92-0aea9eabc166@192.168.202.16@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1789597026.904975:0:18445:0:(genops.c:1384:class_connect()) connect: client 7aa843d4-eae2-4ed1-be92-0aea9eabc166, cookie 0x7b5398e289bbff4d 00000004:00100000:0.0:1789597026.904993:0:18445:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789597026.905222:0:18445:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f13000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597026.905257:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2405:x1876527961723776:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 343us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.905263:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1789597026.922790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597026.922831:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597026.922870:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.929925:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724032 00000100:00100000:2.0:1789597026.929950:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724032 00000100:00100000:2.0:1789597026.930116:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723904 00000100:00100000:2.0:1789597026.930120:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723904 00000100:00100000:3.0:1789597026.930209:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961723648 00000100:00100000:3.0:1789597026.930214:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961723648 00000100:00100000:3.0:1789597026.930273:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1789597026.930288:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:14882:x1876527961724032:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789597026.930344:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789597026.930481:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:14882:x1876527961724032:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 196us (7706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597026.930489:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789597026.933232:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1789597026.933250:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:0:x1876527961723648:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789597026.933300:0:17048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789597026.933411:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:0:x1876527961723648:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 165us (10539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.933439:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00080000:1.0:1789597026.934243:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597026.934251:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597026.934743:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1789597026.934777:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:0:x1876527961723904:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789597026.934822:0:17046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597026.941632:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:0:x1876527961723904:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 6844us (18765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.941655:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789597026.946026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.948003:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724160 00000100:00100000:0.0:1789597026.948029:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724160 00000100:00100000:1.0:1789597026.948458:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789597026.948474:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14882:x1876527961724160:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789597026.949292:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14882:x1876527961724160:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 804us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597026.949307:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789597026.954650:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597026.954742:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597026.954827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597026.954930:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724544 00000100:00100000:2.0:1789597026.954945:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724544 00000100:00100000:2.0:1789597026.955024:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789597026.955038:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14882:x1876527961724544:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789597026.955149:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14882:x1876527961724544:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 113us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597026.955158:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1789597026.955672:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724288 00000100:00100000:0.0:1789597026.955715:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724288 00000100:00100000:0.0:1789597026.955753:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724416 00000100:00100000:0.0:1789597026.955766:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724416 00000100:00100000:0.0:1789597026.955789:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789597026.955797:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1876527961724288:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789597026.955837:0:18556:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7aa843d4-eae2-4ed1-be92-0aea9eabc166@192.168.202.16@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1789597026.955886:0:18556:0:(genops.c:1384:class_connect()) connect: client 7aa843d4-eae2-4ed1-be92-0aea9eabc166, cookie 0x7b5398e289bbff54 00002000:00100000:0.0:1789597026.955904:0:18556:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7aa843d4-eae2-4ed1-be92-0aea9eabc166/ffff9c7ec1f16800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789597026.955930:0:18556:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789597026.956224:0:18556:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789597026.956268:0:18556:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f13800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597026.956408:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1789597026.956415:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1876527961724416:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789597026.956440:0:18557:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7aa843d4-eae2-4ed1-be92-0aea9eabc166@192.168.202.16@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:1.0:1789597026.956465:0:18557:0:(genops.c:1384:class_connect()) connect: client 7aa843d4-eae2-4ed1-be92-0aea9eabc166, cookie 0x7b5398e289bbff5b 00002000:00100000:1.0:1789597026.956472:0:18557:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7aa843d4-eae2-4ed1-be92-0aea9eabc166/ffff9c7d831a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789597026.956480:0:18557:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789597026.956648:0:18557:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789597026.956665:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d831a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597026.956768:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2405:x1876527961724416:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 341us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597026.956777:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789597026.957718:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2405:x1876527961724288:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 1912us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597026.957729:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789597026.964004:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597026.964205:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724672 00000100:00100000:0.0:1789597026.964219:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724672 00000100:00100000:0.0:1789597026.964306:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789597026.964318:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14882:x1876527961724672:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789597026.968821:0:17049:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4377us 00000004:00200000:1.0:1789597026.984456:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789597026.984771:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14882:x1876527961724672:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 20435us (20763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597026.984793:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789597027.160778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597027.160911:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724800 00000100:00100000:0.0:1789597027.160925:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724800 00000100:00100000:0.0:1789597027.161001:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789597027.161014:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14928:x1876527961724800:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:0.0:1789597027.161078:0:18445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597027.161108:0:18445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bbff62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d0b expref: -99 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597027.161188:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bbff69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597027.161203:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bbff69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597027.161216:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bbff69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597027.161272:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789597027.161274:0:18445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597027.161336:0:18445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bbff69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597027.161367:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bbff62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d0b expref: 8 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597027.161386:0:18445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bbff69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d0b expref: 7 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597027.161393:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789597027.161396:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789597027.161399:0:18445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4000, rc 0) 00000100:00100000:0.0:1789597027.161480:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:14928:x1876527961724800:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 468us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597027.161486:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1789597027.261464:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597027.261502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984879488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597027.261612:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597027.261975:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879488 00000100:00100000:3.0:1789597027.261989:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879488 00000100:00100000:3.0:1789597027.262111:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597027.262128:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984879488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789597027.262169:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597027.262242:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984879488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597027.262250:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597027.262323:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984879488:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789597027.262531:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789597027.646714:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597028.669826:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597029.313649:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789597029.313672:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789597029.313704:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984879616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597029.313705:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984879744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597029.313853:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597029.313864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984879872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597029.316730:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597029.317049:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879616 00000100:00100000:1.0:1789597029.317066:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879616 00000100:00100000:1.0:1789597029.317159:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789597029.317173:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984879616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597029.317266:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789597029.321468:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984879616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4273us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597029.321493:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789597029.324924:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d825f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984879616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597029.330442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597029.330609:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879744 00000100:00100000:0.0:1789597029.330629:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879744 00000100:00100000:3.0:1789597029.330663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.330758:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961724928 00000100:00100000:3.0:1789597029.330762:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961724928 00000100:00100000:0.0:1789597029.330851:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789597029.330867:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984879744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597029.330928:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597029.331036:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984879744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597029.331045:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789597029.331257:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597029.332799:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984879872 00000100:00100000:0.0:1789597029.332821:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984879872 00000100:00100000:0.0:1789597029.332916:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789597029.332930:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984879872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789597029.332993:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597029.333650:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984879744:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789597029.335396:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789597029.335416:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597029.338294:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984879872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5348us (7017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597029.338319:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789597029.339483:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984879872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789597029.342824:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789597029.342868:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:14980:x1876527961724928:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:3.0:1789597029.342927:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789597029.343104:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:14980:x1876527961724928:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 261us (12442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.343114:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789597029.360663:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.363525:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725056 00000100:00100000:2.0:1789597029.363555:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725056 00000100:00100000:2.0:1789597029.363719:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:2.0:1789597029.363732:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14980:x1876527961725056:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:2.0:1789597029.363792:0:18445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597029.363943:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14980:x1876527961725056:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 213us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.363951:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:1.0:1789597029.364488:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789597029.371418:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.371556:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725184 00000100:00100000:3.0:1789597029.371573:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725184 00000100:00100000:3.0:1789597029.371799:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1789597029.371814:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14980:x1876527961725184:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:3.0:1789597029.371851:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597029.372012:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14980:x1876527961725184:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 200us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.372021:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:1.0:1789597029.373421:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597029.379844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.380396:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725312 00000100:00100000:3.0:1789597029.380414:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725312 00000100:00100000:3.0:1789597029.380536:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789597029.380552:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14980:x1876527961725312:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:3.0:1789597029.380614:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1789597029.381550:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597029.387293:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:14980:x1876527961725312:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 6719us (7442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.387318:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789597029.685992:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.686991:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725440 00000100:00100000:2.0:1789597029.687010:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725440 00000100:00100000:2.0:1789597029.687114:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:2.0:1789597029.687128:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+10:15013:x1876527961725440:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789597029.687154:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597029.687187:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbff70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d12 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.687253:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbff70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d12 expref: 11 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.687269:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbff70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d12 expref: 11 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.687280:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da800, rc 0) 00000100:00100000:2.0:1789597029.687384:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+11:15013:x1876527961725440:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 250us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.687392:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00010000:00010000:2.0:1789597029.693274:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597029.698810:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.699065:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725568 00000100:00100000:2.0:1789597029.699084:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725568 00000100:00100000:2.0:1789597029.699183:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:2.0:1789597029.699198:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+11:15013:x1876527961725568:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789597029.699476:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+11:15013:x1876527961725568:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 280us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.699488:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:0.0:1789597029.707356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.707599:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725696 00000100:00100000:3.0:1789597029.707617:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725696 00000100:00100000:3.0:1789597029.707810:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:3.0:1789597029.707828:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+11:15013:x1876527961725696:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789597029.708079:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+11:15013:x1876527961725696:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 252us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.708088:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:0.0:1789597029.712744:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.712874:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725824 00000100:00100000:3.0:1789597029.712889:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725824 00000100:00100000:3.0:1789597029.712970:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1789597029.712995:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+11:15020:x1876527961725824:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597029.713418:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+11:15020:x1876527961725824:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 434us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.713428:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:0.0:1789597029.729983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.730148:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961725952 00000100:00100000:3.0:1789597029.730165:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961725952 00000100:00100000:3.0:1789597029.730254:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:3.0:1789597029.730278:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+11:15020:x1876527961725952:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597029.730485:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+11:15020:x1876527961725952:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 210us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.730495:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:0.0:1789597029.741388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.743450:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726080 00000100:00100000:3.0:1789597029.743797:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726080 00000100:00100000:3.0:1789597029.743975:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:3.0:1789597029.743989:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+11:15020:x1876527961726080:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597029.747863:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+11:15020:x1876527961726080:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 3857us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.747881:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:0.0:1789597029.763211:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.763488:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726208 00000100:00100000:2.0:1789597029.763504:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726208 00000100:00100000:2.0:1789597029.763602:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:2.0:1789597029.763615:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+11:15013:x1876527961726208:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789597029.763641:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597029.763667:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbff77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d43 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.763786:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbff77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d43 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.763800:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbff77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d43 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.763811:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:2.0:1789597029.765234:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+12:15013:x1876527961726208:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 1607us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.765248:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:0.0:1789597029.769085:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.769251:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726336 00000100:00100000:3.0:1789597029.769268:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726336 00000100:00100000:3.0:1789597029.769355:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:3.0:1789597029.769368:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+12:15013:x1876527961726336:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789597029.769413:0:17040:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789597029.769466:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789597029.769472:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789597029.769476:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789597029.769479:0:17040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789597029.769481:0:17040:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789597029.773523:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+12:15013:x1876527961726336:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 4124us (4424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.773547:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1789597029.782968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.783169:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726464 00000100:00100000:2.0:1789597029.783185:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726464 00000100:00100000:2.0:1789597029.783601:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:2.0:1789597029.783629:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+12:15013:x1876527961726464:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789597029.783658:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597029.783717:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d4a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.783776:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 13 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.783791:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 13 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597029.783803:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:2.0:1789597029.783897:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:15013:x1876527961726464:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 282us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.783928:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:0.0:1789597029.788133:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.788318:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726592 00000100:00100000:3.0:1789597029.788335:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726592 00000100:00100000:3.0:1789597029.788426:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:3.0:1789597029.788442:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:15013:x1876527961726592:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789597029.791975:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:15013:x1876527961726592:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 3520us (3844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597029.792058:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:1.0:1789597029.800130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597029.800297:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726720 00000100:00100000:0.0:1789597029.800316:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726720 00000100:00100000:0.0:1789597029.800421:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:0.0:1789597029.800434:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+13:15013:x1876527961726720:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789597029.800716:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+13:15013:x1876527961726720:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 248us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597029.800725:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:1.0:1789597029.818222:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.818886:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726848 00000100:00100000:2.0:1789597029.818903:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726848 00000100:00100000:2.0:1789597029.819113:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:2.0:1789597029.819129:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:15025:x1876527961726848:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789597029.819402:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:15025:x1876527961726848:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 276us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.819410:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:3.0:1789597029.831531:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.831890:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961726976 00000100:00100000:2.0:1789597029.831906:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961726976 00000100:00100000:2.0:1789597029.831991:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:2.0:1789597029.832004:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:15025:x1876527961726976:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789597029.832547:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:15025:x1876527961726976:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 542us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.832558:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:1.0:1789597029.846382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.846726:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727104 00000100:00100000:2.0:1789597029.846761:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727104 00000100:00100000:2.0:1789597029.846832:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789597029.846845:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1876527961727104:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789597029.846894:0:17048:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cded1d0b-04a6-4ab1-ac9e-f9279e87941c@192.168.202.16@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:2.0:1789597029.846951:0:17048:0:(genops.c:1384:class_connect()) connect: client cded1d0b-04a6-4ab1-ac9e-f9279e87941c, cookie 0x7b5398e289bbff85 00000004:00100000:2.0:1789597029.846997:0:17048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789597029.847154:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c8b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597029.847481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.847525:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2405:x1876527961727104:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 680us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.847556:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789597029.847580:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727360 00000100:00100000:2.0:1789597029.847584:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727360 00000100:00100000:2.0:1789597029.847606:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789597029.847612:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1876527961727360:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789597029.847632:0:17048:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from cded1d0b-04a6-4ab1-ac9e-f9279e87941c@192.168.202.16@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:2.0:1789597029.847716:0:17048:0:(genops.c:1384:class_connect()) connect: client cded1d0b-04a6-4ab1-ac9e-f9279e87941c, cookie 0x7b5398e289bbff8c 00000004:00100000:2.0:1789597029.847745:0:17048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789597029.847810:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f0a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597029.852206:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2405:x1876527961727360:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 4571us (4705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.852227:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789597029.867363:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597029.867420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597029.867456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597029.867499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.868001:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727872 00000100:00100000:2.0:1789597029.868018:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727872 00000100:00100000:2.0:1789597029.868104:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727744 00000100:00100000:2.0:1789597029.868108:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727744 00000100:00100000:2.0:1789597029.868142:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:2.0:1789597029.868155:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961727872:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597029.868276:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961727872:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.868285:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:2.0:1789597029.868309:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1789597029.868317:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2408:x1876527961727744:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597029.868345:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2408:x1876527961727744:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.868374:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789597029.868970:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597029.869082:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728128 00000100:00100000:1.0:1789597029.869089:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728128 00000100:00100000:1.0:1789597029.869135:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728000 00000100:00100000:1.0:1789597029.869140:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728000 00000100:00100000:1.0:1789597029.869176:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789597029.869185:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961728128:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597029.869230:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961728128:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597029.869237:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789597029.869253:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789597029.869260:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961728000:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597029.869284:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961728000:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597029.869304:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789597029.870247:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597029.877821:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597029.877907:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727616 00000100:00100000:3.0:1789597029.877924:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727616 00000100:00080000:1.0:1789597029.878053:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597029.878245:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727488 00000100:00100000:2.0:1789597029.878252:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727488 00000100:00100000:2.0:1789597029.878327:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789597029.878340:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961727616:12345-192.168.202.16@tcp:41:mount.lustre.0 00000100:00080000:1.0:1789597029.878640:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1789597029.878717:0:17048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789597029.878857:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961727616:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 518us (9890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.878867:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789597029.878896:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789597029.878905:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:0:x1876527961727488:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789597029.878922:0:17048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597029.878954:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:0:x1876527961727488:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 50us (8715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.878960:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789597029.880082:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961727232 00000100:00100000:3.0:1789597029.880096:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961727232 00000100:00100000:3.0:1789597029.880237:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:3.0:1789597029.880248:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:0:x1876527961727232:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789597029.880287:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789597029.880354:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:0:x1876527961727232:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 108us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.880581:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789597029.894058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.895578:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728256 00000100:00100000:2.0:1789597029.895601:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728256 00000100:00100000:2.0:1789597029.895715:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789597029.895740:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961728256:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789597029.895879:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961728256:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 151us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.895887:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789597029.914991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597029.915042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597029.915160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597029.915210:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728640 00000100:00100000:1.0:1789597029.915227:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728640 00000100:00100000:1.0:1789597029.915311:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789597029.915324:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961728640:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789597029.915474:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961728640:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 153us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597029.915484:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789597029.915879:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728384 00000100:00100000:3.0:1789597029.915886:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728384 00000100:00100000:3.0:1789597029.915929:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728512 00000100:00100000:3.0:1789597029.915932:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728512 00000100:00100000:3.0:1789597029.915959:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789597029.915966:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1876527961728384:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789597029.916007:0:18557:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cded1d0b-04a6-4ab1-ac9e-f9279e87941c@192.168.202.16@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:3.0:1789597029.916059:0:18557:0:(genops.c:1384:class_connect()) connect: client cded1d0b-04a6-4ab1-ac9e-f9279e87941c, cookie 0x7b5398e289bbff93 00002000:00100000:3.0:1789597029.916079:0:18557:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cded1d0b-04a6-4ab1-ac9e-f9279e87941c/ffff9c7d83f23800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789597029.916096:0:18557:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789597029.916225:0:18557:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789597029.916268:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f24000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597029.916329:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2405:x1876527961728384:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 362us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.916337:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789597029.916357:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789597029.916361:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1876527961728512:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789597029.916397:0:18557:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cded1d0b-04a6-4ab1-ac9e-f9279e87941c@192.168.202.16@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:3.0:1789597029.916418:0:18557:0:(genops.c:1384:class_connect()) connect: client cded1d0b-04a6-4ab1-ac9e-f9279e87941c, cookie 0x7b5398e289bbff9a 00002000:00100000:3.0:1789597029.916424:0:18557:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cded1d0b-04a6-4ab1-ac9e-f9279e87941c/ffff9c7d83f20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789597029.916430:0:18557:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789597029.916483:0:18557:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789597029.916499:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f25000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597029.916547:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2405:x1876527961728512:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 183us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597029.916554:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789597029.917830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597029.918516:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728768 00000100:00100000:2.0:1789597029.918531:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728768 00000100:00100000:2.0:1789597029.918640:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:2.0:1789597029.918653:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961728768:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789597029.918833:0:17050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789597029.918956:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15013:x1876527961728768:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 305us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597029.918964:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789597030.165765:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597030.166140:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961728896 00000100:00100000:1.0:1789597030.166156:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961728896 00000100:00100000:1.0:1789597030.166247:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1789597030.166270:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15048:x1876527961728896:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:1.0:1789597030.166302:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597030.166340:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbffa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d7b expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597030.166435:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597030.166454:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597030.166490:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597030.166556:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789597030.166561:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789597030.166591:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597030.166626:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bbffa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 8 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597030.166652:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 7 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597030.166662:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:1.0:1789597030.166666:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789597030.166671:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1600, rc 0) 00000100:00100000:1.0:1789597030.166813:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+7:15048:x1876527961728896:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 545us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597030.166822:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000040:00080000:3.0:1789597030.400065:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789597030.718763:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597030.845468:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984880000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789597030.845780:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.845851:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984880512:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.845879:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.845919:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984881024:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.845942:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.845962:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984881536:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.845989:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.846015:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789597030.846021:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984880128:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.846048:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.846069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984880640:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.846089:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.846106:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984881152:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.846125:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.846141:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984881664:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.846158:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597030.846191:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880512 00000100:00100000:3.0:1789597030.846401:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881024 00000100:00100000:3.0:1789597030.846407:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881024 00000100:00100000:3.0:1789597030.846473:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597030.846485:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984881024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846639:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984880384:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846675:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597030.846736:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984880896:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846763:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597030.846775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984881408:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846795:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597030.846808:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789597030.846814:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984880256:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846839:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597030.846858:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984880768:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846877:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597030.846894:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984881280:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.846916:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597030.846938:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880000 00000100:00100000:2.0:1789597030.846942:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880000 00000100:00100000:2.0:1789597030.846972:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789597030.846979:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984880000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789597030.847005:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789597030.847067:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984880000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597030.847075:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789597030.847101:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881536 00000100:00100000:2.0:1789597030.847106:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881536 00000100:00100000:2.0:1789597030.847127:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880640 00000100:00100000:2.0:1789597030.847130:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880640 00000100:00100000:2.0:1789597030.847141:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881152 00000100:00100000:2.0:1789597030.847144:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881152 00000100:00100000:2.0:1789597030.847154:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881664 00000100:00100000:2.0:1789597030.847156:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881664 00000100:00100000:2.0:1789597030.847168:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881408 00000100:00100000:2.0:1789597030.847169:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881408 00000100:00100000:0.0:1789597030.847455:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880512 00000100:00100000:0.0:1789597030.847479:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880384 00000100:00100000:0.0:1789597030.847483:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880384 00000100:00100000:3.0:1789597030.847708:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984881024:12345-0@lo:400:kworker.0 Request processed in 1224us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597030.847716:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597030.847740:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880896 00000100:00100000:3.0:1789597030.847744:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880896 00000100:00100000:3.0:1789597030.847759:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597030.847765:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984880512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597030.847795:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984880512:12345-0@lo:400:kworker.0 Request processed in 29us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597030.847801:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597030.847813:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789597030.847819:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e8762ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984880896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597030.847854:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e8762ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984880896:12345-0@lo:400:kworker.0 Request processed in 35us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597030.847860:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789597030.847907:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984880896:0@lo:400:kworker.0 00000100:00100000:3.0:1789597030.848058:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880128 00000100:00100000:3.0:1789597030.848063:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880128 00000100:00100000:3.0:1789597030.848104:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789597030.848110:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984880128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597030.848143:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984880128:12345-0@lo:400:kworker.0 Request processed in 33us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597030.848150:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789597030.848187:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880256 00000100:00100000:3.0:1789597030.848191:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880256 00000100:00100000:0.0:1789597030.848375:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789597030.848384:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984880384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.848422:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984880384:12345-0@lo:400:kworker.0 Request processed in 41us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.848429:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789597030.848899:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881280 00000100:00100000:0.0:1789597030.848906:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881280 00000100:00100000:0.0:1789597030.848934:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789597030.848941:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.848987:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984881536:12345-0@lo:400:kworker.0 Request processed in 47us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.848993:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789597030.849005:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789597030.849010:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984880640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.849031:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984880640:12345-0@lo:400:kworker.0 Request processed in 21us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.849036:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789597030.849045:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789597030.849050:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984881152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.849070:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984881152:12345-0@lo:400:kworker.0 Request processed in 21us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.849075:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789597030.849084:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789597030.849089:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.849111:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984881664:12345-0@lo:400:kworker.0 Request processed in 22us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.849115:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789597030.849124:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789597030.849129:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984881408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.849151:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984881408:12345-0@lo:400:kworker.0 Request processed in 22us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.849156:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789597030.849165:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789597030.849170:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984881280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.849330:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984880768 00000100:00100000:2.0:1789597030.849335:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984880768 00000100:00100000:2.0:1789597030.849365:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789597030.849371:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984880768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597030.850758:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789597030.850769:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984880256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.850946:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984880768:12345-0@lo:400:kworker.0 Request processed in 1574us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597030.850955:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789597030.851045:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984880128:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851063:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984880640:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851078:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984881152:0@lo:400:kworker.0 00010000:00080000:2.0:1789597030.851093:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e92d42300 x1876527984881664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597030.851104:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984881664:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851116:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789597030.851161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984880000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597030.851181:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984880512:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851193:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984881024:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851206:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984881536:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851291:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984880768:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851307:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984881280:0@lo:400:kworker.0 00000100:00100000:2.0:1789597030.851317:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984880384:0@lo:400:kworker.0 00010000:00080000:2.0:1789597030.851327:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e92d40700 x1876527984881408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597030.851336:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984881408:0@lo:400:kworker.0 00000100:00080000:2.0:1789597030.851373:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789597030.851379:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789597030.851382:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597030.851384:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789597030.851508:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984880256:12345-0@lo:400:kworker.0 Request processed in 740us (4666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597030.851515:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789597030.851760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984881792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789597030.851803:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597030.851847:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881792 00000100:00100000:3.0:1789597030.851855:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881792 00000100:00100000:3.0:1789597030.851889:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597030.851896:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984881792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789597030.851914:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789597030.851965:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984881792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597030.851971:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789597030.852164:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984881792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597030.852186:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984880256:0@lo:400:kworker.0 00000100:00100000:0.0:1789597030.855392:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984881280:12345-0@lo:400:kworker.0 Request processed in 6201us (8454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597030.855411:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1789597031.745566:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597032.381191:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597032.381217:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984881920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597032.381364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597032.381474:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984881920 00000100:00100000:3.0:1789597032.381492:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984881920 00000100:00100000:3.0:1789597032.381569:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789597032.381580:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984881920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789597032.381612:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597032.381703:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984881920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597032.381719:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789597032.381897:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597032.381936:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984881920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789597032.765029:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789597032.903510:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:3.0:1789597032.903533:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000001:00100000:1.0:1789597032.909179:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:1.0:1789597032.909203:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000001:00100000:1.0:1789597032.909828:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:1.0:1789597032.909846:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000001:00100000:2.0:1789597032.912137:0:17026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:2.0:1789597032.912156:0:17026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000040:00080000:1.0:1789597033.277637:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789597033.802915:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789597033.831075:0:19928:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789597034.428975:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789597034.429004:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984882048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597034.429098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597034.429263:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882048 00000100:00100000:1.0:1789597034.429273:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882048 00000100:00100000:1.0:1789597034.429327:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789597034.429336:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984882048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597034.429375:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789597034.429442:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984882048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597034.429449:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789597034.429549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984882048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597034.430436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984882176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597034.430495:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597034.430606:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882176 00000100:00100000:3.0:1789597034.430613:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882176 00000100:00100000:3.0:1789597034.430674:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789597034.430722:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984882176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789597034.430755:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597034.430802:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984882176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597034.430811:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789597034.431009:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597034.431056:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984882176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597034.435305:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597034.435331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984882304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789597034.435419:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597034.435848:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882304 00000100:00100000:0.0:1789597034.435859:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882304 00000100:00100000:0.0:1789597034.435925:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789597034.435936:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984882304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789597034.435975:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597034.436034:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984882304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597034.436041:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789597034.436168:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984882304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789597034.813392:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597035.002601:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002672:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002765:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002824:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002900:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002923:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597035.002957:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729408 00000100:00100000:3.0:1789597035.002969:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729408 00000100:00100000:3.0:1789597035.003038:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729920 00000100:00100000:3.0:1789597035.003040:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729920 00000100:00100000:3.0:1789597035.003052:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729536 00000100:00100000:3.0:1789597035.003055:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729536 00000100:00100000:3.0:1789597035.003066:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730048 00000100:00100000:3.0:1789597035.003069:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730048 00000100:00100000:3.0:1789597035.003085:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789597035.003095:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961729408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003189:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961729408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 94us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003197:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789597035.003231:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789597035.003238:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961729920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003264:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961729920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003270:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789597035.003282:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789597035.003288:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961729536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003311:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961729536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003330:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789597035.003343:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789597035.003349:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961730048:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003376:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961730048:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003382:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789597035.003404:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729024 00000100:00100000:3.0:1789597035.003408:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729024 00000100:00100000:3.0:1789597035.003436:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:3.0:1789597035.003444:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961729024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003471:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961729024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003477:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:3.0:1789597035.003513:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729152 00000100:00100000:3.0:1789597035.003518:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729152 00000100:00100000:3.0:1789597035.003542:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729664 00000100:00100000:3.0:1789597035.003545:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729664 00000100:00100000:3.0:1789597035.003556:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729280 00000100:00100000:3.0:1789597035.003558:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729280 00000100:00100000:3.0:1789597035.003569:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961729792 00000100:00100000:3.0:1789597035.003572:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961729792 00000100:00100000:3.0:1789597035.003585:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789597035.003592:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961729152:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003626:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961729152:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003633:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789597035.003654:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789597035.003661:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2408:x1876527961729664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003734:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2408:x1876527961729664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 73us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003740:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789597035.003752:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:3.0:1789597035.003758:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961729280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003783:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961729280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003789:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:3.0:1789597035.003800:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789597035.003806:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961729792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597035.003826:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961729792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 20us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.003831:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00080000:3.0:1789597035.003863:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789597035.003869:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789597035.003872:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789597035.003874:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789597035.845672:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597035.966564:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984882432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789597035.966708:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597035.966803:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984882560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597035.966830:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597035.966870:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882432 00000100:00100000:1.0:1789597035.966880:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882432 00000100:00100000:1.0:1789597035.966942:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882560 00000100:00100000:1.0:1789597035.966946:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882560 00000100:00100000:1.0:1789597035.966966:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789597035.966977:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984882432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789597035.967016:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789597035.967075:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984882432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597035.967098:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789597035.967121:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597035.967128:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984882560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789597035.967138:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789597035.967168:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984882560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597035.967174:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789597035.967196:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597035.967546:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984882560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597035.967586:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984882432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597035.974834:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984882688:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.974956:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597035.975022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984883200:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975058:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597035.975092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984883712:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597035.975188:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789597035.975195:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984883072:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975346:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597035.975367:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984883584:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975388:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597035.975424:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882688 00000100:00100000:3.0:1789597035.975435:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882688 00000100:00100000:3.0:1789597035.975561:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789597035.975570:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:3647:x1876527984882688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975625:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:3647:x1876527984882688:12345-0@lo:400:kworker.0 Request processed in 55us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.975633:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789597035.975772:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883712 00000100:00100000:3.0:1789597035.975776:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883712 00000100:00100000:3.0:1789597035.975821:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883072 00000100:00100000:3.0:1789597035.975824:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883072 00000100:00100000:3.0:1789597035.975834:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883584 00000100:00100000:3.0:1789597035.975836:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883584 00000100:00100000:3.0:1789597035.975851:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789597035.975858:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984883712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975891:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984883712:12345-0@lo:400:kworker.0 Request processed in 34us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.975898:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789597035.975908:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789597035.975914:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984883072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.975939:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984883072:12345-0@lo:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.975955:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789597035.975967:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789597035.975972:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984883584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.976002:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984883584:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597035.976008:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789597035.976082:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984883072:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.976096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984883584:0@lo:400:kworker.0 00000100:00100000:3.0:1789597035.976104:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984882688:0@lo:400:kworker.0 00010000:00080000:3.0:1789597035.976118:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d84451c00 x1876527984883712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597035.976130:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984883712:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.976531:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883200 00000100:00100000:0.0:1789597035.976539:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883200 00000100:00100000:0.0:1789597035.976592:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789597035.976600:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984883200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.976933:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984883200:12345-0@lo:400:kworker.0 Request processed in 333us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597035.976940:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789597035.978405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984883200:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.978580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb9918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984882816:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.978876:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597035.979287:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984883328:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979342:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597035.979373:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984883840:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979400:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597035.979430:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789597035.979438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb991b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984882944:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597035.979567:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984883456:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979589:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597035.979607:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984883968:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979626:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597035.979706:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883328 00000100:00100000:0.0:1789597035.979715:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883328 00000100:00100000:0.0:1789597035.979770:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882944 00000100:00100000:0.0:1789597035.979774:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882944 00000100:00100000:0.0:1789597035.979807:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789597035.979817:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984883328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979887:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984883328:12345-0@lo:400:kworker.0 Request processed in 71us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597035.979896:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789597035.979917:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789597035.979923:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984882944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.979950:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984882944:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597035.979957:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789597035.979981:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883840 00000100:00100000:0.0:1789597035.979985:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883840 00000100:00100000:0.0:1789597035.980027:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883456 00000100:00100000:0.0:1789597035.980030:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883456 00000100:00100000:0.0:1789597035.980040:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984883968 00000100:00100000:0.0:1789597035.980043:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984883968 00000100:00100000:0.0:1789597035.980058:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789597035.980064:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984883840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.980097:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984883840:12345-0@lo:400:kworker.0 Request processed in 33us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597035.980103:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789597035.980115:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597035.980120:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984883456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.980146:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984883456:12345-0@lo:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597035.980152:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597035.980163:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789597035.980168:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.980195:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984883968:12345-0@lo:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597035.980200:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789597035.980244:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb991b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984882944:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.980255:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984883456:0@lo:400:kworker.0 00010000:00080000:0.0:1789597035.980268:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d84452a00 x1876527984883968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597035.980279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984883968:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.980288:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984883328:0@lo:400:kworker.0 00000100:00100000:0.0:1789597035.980310:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984883840:0@lo:400:kworker.0 00000100:00080000:0.0:1789597035.980391:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789597035.980397:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597035.980400:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597035.981208:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984882816 00000100:00100000:2.0:1789597035.981219:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984882816 00000100:00100000:2.0:1789597035.981272:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789597035.981281:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984882816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597035.981375:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984882816:12345-0@lo:400:kworker.0 Request processed in 95us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597035.981383:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789597035.981428:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb9918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984882816:0@lo:400:kworker.0 00010000:00010000:0.0:1789597036.865012:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597037.500955:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597037.500993:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984884096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597037.501098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597037.501259:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984884096 00000100:00100000:0.0:1789597037.501271:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984884096 00000100:00080000:1.0:1789597037.501412:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789597037.501456:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789597037.501471:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984884096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789597037.501509:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597037.501571:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984884096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597037.501578:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597037.501652:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984884096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789597037.889481:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789597038.227617:0:20075:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2b2b0c70 20000000:00000080:1.0:1789597038.227645:0:20075:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7ec1f02c00 uarg=0000000000000000 20000000:01000000:1.0:1789597038.227970:0:20075:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789597038.227978:0:20075:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789597038.227984:0:20075:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789597038.228568:0:20076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789597038.228952:0:20075:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789597038.236251:0:20075:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789597038.236293:0:20075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236340:0:20075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236348:0:20075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236355:0:20075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236362:0:20075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236373:0:20075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236381:0:20075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236389:0:20075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236521:0:20075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.236539:0:20075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 12 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597038.236556:0:20075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884224:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597038.237017:0:20075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237035:0:20075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 12 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597038.237045:0:20075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884352:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597038.237080:0:20075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237089:0:20075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 23 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597038.237099:0:20075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884480:0@lo:104: 00000100:00100000:1.0:1789597038.237140:0:20075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789597038.237197:0:20075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237206:0:20075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 23 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597038.237214:0:20075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884608:0@lo:104: 00000100:00100000:1.0:1789597038.237235:0:20075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597038.237271:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984884480 00000100:00100000:1.0:1789597038.237279:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984884480 00000100:00100000:1.0:1789597038.237342:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984884608 00000100:00100000:1.0:1789597038.237346:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984884608 00000100:00100000:1.0:1789597038.237362:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789597038.237370:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+4:20075:x1876527984884480:12345-0@lo:104: 00010000:00010000:1.0:1789597038.237383:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237451:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789597038.237457:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+4:20075:x1876527984884480:12345-0@lo:104: Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597038.237464:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789597038.237484:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789597038.237490:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:20075:x1876527984884608:12345-0@lo:104: 00010000:00010000:1.0:1789597038.237498:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237530:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789597038.237535:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:20075:x1876527984884608:12345-0@lo:104: Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597038.237540:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789597038.237558:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597038.237566:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237573:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81510e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597038.237577:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237586:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597038.237594:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597038.237600:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789597038.237876:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237884:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597038.237904:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237912:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81510e00/0x7b5398e289bbfde8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfdef expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237927:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597038.237930:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237936:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597038.237939:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237947:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597038.237954:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597038.237960:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789597038.237975:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.237980:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597038.237994:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238011:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bbfc8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc91 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238021:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238023:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238025:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597038.238039:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984884736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597038.238071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789597038.238126:0:20075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238138:0:20075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 23 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597038.238147:0:20075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884992:0@lo:104: 00000100:00100000:1.0:1789597038.238169:0:20075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597038.238254:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984884992 00000100:00100000:1.0:1789597038.238258:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984884992 00000100:00100000:1.0:1789597038.238279:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789597038.238285:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:20075:x1876527984884992:12345-0@lo:104: 00010000:00010000:1.0:1789597038.238293:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238330:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789597038.238335:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:20075:x1876527984884992:12345-0@lo:104: Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597038.238341:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789597038.238364:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597038.238369:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238375:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dce00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597038.238378:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238385:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597038.238392:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597038.238396:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789597038.238414:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238420:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597038.238496:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238503:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dce00/0x7b5398e289bbfc4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc52 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238513:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238515:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238517:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238536:0:20075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238545:0:20075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 23 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597038.238564:0:20075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984885248:0@lo:104: 00000100:00100000:1.0:1789597038.238587:0:20075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597038.238608:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885248 00000100:00100000:1.0:1789597038.238612:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885248 00000100:00100000:1.0:1789597038.238629:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597038.238634:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:20075:x1876527984885248:12345-0@lo:104: 00010000:00010000:1.0:1789597038.238642:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238860:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789597038.238866:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f66223a4-de53-4574-9339-460f93dd2c76+3:20075:x1876527984885248:12345-0@lo:104: Request processed in 232us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597038.238872:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789597038.238887:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597038.238891:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238898:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597038.238901:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238907:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597038.238913:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597038.238919:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789597038.238939:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238945:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597038.238957:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238963:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc600/0x7b5398e289bbfc3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bbfc44 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597038.238977:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238979:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597038.238980:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597038.238989:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597038.238997:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984885376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597038.239023:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597038.239057:0:20075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9187c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597038.239081:0:20075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884480:0@lo:104: 00000100:00100000:1.0:1789597038.239091:0:20075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884608:0@lo:104: 00000100:00100000:1.0:1789597038.239098:0:20075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884992:0@lo:104: 00000100:00100000:1.0:1789597038.239104:0:20075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984885248:0@lo:104: 00010000:00010000:0.0:1789597038.239652:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597038.239700:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984885120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597038.239735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597038.239768:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789597038.239775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984884864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597038.239795:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597038.240013:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984884736 00000100:00100000:3.0:1789597038.240020:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984884736 00010000:00010000:3.0:1789597038.240050:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 24 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597038.240088:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885376 00000100:00100000:3.0:1789597038.240091:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885376 00010000:00010000:3.0:1789597038.240105:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 25 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597038.240114:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885120 00000100:00100000:3.0:1789597038.240116:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885120 00010000:00010000:3.0:1789597038.240126:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 26 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597038.240135:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984884864 00000100:00100000:3.0:1789597038.240137:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984884864 00010000:00010000:3.0:1789597038.240146:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 27 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597038.240159:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789597038.240166:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+27:3647:x1876527984884736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597038.240189:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597038.240195:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 27 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240206:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 27 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240219:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a0000/0x7b5398e289bbfdef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfde8 expref: 27 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240234:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597038.240281:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+26:3647:x1876527984884736:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597038.240297:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789597038.240316:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789597038.240322:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+25:3647:x1876527984885376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597038.240330:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597038.240335:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 25 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240342:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 25 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240352:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a1e00/0x7b5398e289bbfc44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfc3d expref: 25 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240361:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597038.240383:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+24:3647:x1876527984885376:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597038.240389:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789597038.240402:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597038.240407:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+23:3645:x1876527984885120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597038.240415:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597038.240418:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 23 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240436:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 23 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240447:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743a00/0x7b5398e289bbfc52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfc4b expref: 23 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240467:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597038.240495:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+22:3645:x1876527984885120:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597038.240500:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597038.240512:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597038.240518:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+21:3645:x1876527984884864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597038.240526:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597038.240530:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 21 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240538:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 21 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240548:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dd400/0x7b5398e289bbfc91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bbfc8a expref: 21 pid: 17041 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.240557:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597038.240578:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+20:3645:x1876527984884864:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597038.240584:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789597038.240920:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984885376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597038.240930:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984884736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597038.240966:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984884864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597038.240973:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984885120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597038.248291:0:20075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884224:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789597038.248310:0:20075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20075:1876527984884352:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789597038.248349:0:20075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597038.249592:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597038.250463:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597038.250886:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730176 00000100:00100000:3.0:1789597038.250897:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730176 00010000:00010000:3.0:1789597038.250939:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 13 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597038.250980:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730304 00000100:00100000:3.0:1789597038.250984:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730304 00010000:00010000:3.0:1789597038.250996:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 14 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597038.251046:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789597038.251057:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1face98e-a79e-4341-9221-d059c3bcf042+14:2408:x1876527961730176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597038.251074:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597038.251081:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 14 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251094:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 14 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251113:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db800/0x7b5398e289bbff7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d4a expref: 14 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251128:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597038.251195:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961730176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 139us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597038.251202:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789597038.251250:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789597038.251257:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1face98e-a79e-4341-9221-d059c3bcf042+12:2409:x1876527961730304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597038.251265:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597038.251269:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 12 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251277:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 12 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251287:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db600/0x7b5398e289bbff3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cda expref: 12 pid: 17039 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251305:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251314:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251330:0:17033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251337:0:17033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251344:0:17033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251351:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251357:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597038.251361:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251368:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251379:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597038.251389:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597038.251409:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1face98e-a79e-4341-9221-d059c3bcf042+11:2409:x1876527961730304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 152us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597038.251422:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00010000:00010000:2.0:1789597038.251819:0:20075:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597038.251830:0:20075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597038.251837:0:20075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a1000/0x7b5398e289bbffaf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597038.912536:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597039.543239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597039.543369:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730432 00000100:00100000:0.0:1789597039.543384:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730432 00000100:00100000:0.0:1789597039.543465:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:0.0:1789597039.543478:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+11:14896:x1876527961730432:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597039.543505:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597039.543545:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e5400/0x7b5398e289bbffb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d82 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597039.543586:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e5400/0x7b5398e289bbffb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d82 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597039.543614:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e5400/0x7b5398e289bbffb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d82 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597039.543625:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5400, rc 0) 00000100:00100000:0.0:1789597039.543753:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+12:14896:x1876527961730432:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 276us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597039.543762:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:2.0:1789597039.550851:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984885504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597039.550936:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597039.551034:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885504 00000100:00100000:2.0:1789597039.551048:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885504 00000100:00100000:2.0:1789597039.551133:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789597039.551145:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984885504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597039.551224:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789597039.551314:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984885504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597039.551323:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789597039.551401:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984885504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597039.551627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597039.552754:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730560 00000100:00100000:2.0:1789597039.552771:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730560 00000100:00100000:2.0:1789597039.552847:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:2.0:1789597039.552861:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+12:14896:x1876527961730560:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597039.553095:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+12:14896:x1876527961730560:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 235us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597039.553105:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:3.0:1789597039.554526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984885632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597039.554715:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597039.555822:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597039.555845:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984885760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597039.555913:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597039.555965:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885760 00000100:00100000:1.0:1789597039.555976:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885760 00000100:00100000:1.0:1789597039.556048:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789597039.556061:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984885760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597039.556132:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597039.556271:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984885760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 212us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597039.556280:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789597039.556345:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984885760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789597039.556449:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885632 00000100:00100000:2.0:1789597039.556455:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885632 00000100:00100000:2.0:1789597039.556512:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789597039.556522:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984885632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597039.556552:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597039.556614:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984885632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597039.556621:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789597039.557289:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597039.557350:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984885632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597039.558364:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597039.558792:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730688 00000100:00100000:3.0:1789597039.558809:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730688 00000100:00100000:3.0:1789597039.558885:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:3.0:1789597039.558897:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+12:14896:x1876527961730688:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597039.559111:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+12:14896:x1876527961730688:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 216us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597039.559120:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:3.0:1789597039.575404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597039.575510:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730816 00000100:00100000:1.0:1789597039.575523:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730816 00000100:00100000:1.0:1789597039.575598:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:1.0:1789597039.575615:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+12:14896:x1876527961730816:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597039.575640:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597039.575675:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1400/0x7b5398e289bbffbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d89 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597039.575737:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1400/0x7b5398e289bbffbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d89 expref: 13 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597039.575750:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a1400/0x7b5398e289bbffbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d89 expref: 13 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597039.575761:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1400, rc 0) 00000100:00100000:1.0:1789597039.575840:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:14896:x1876527961730816:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 227us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597039.575848:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:1.0:1789597039.580415:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597039.587781:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961730944 00000100:00100000:3.0:1789597039.587810:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961730944 00000100:00100000:3.0:1789597039.587909:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:3.0:1789597039.587924:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:14896:x1876527961730944:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597039.588169:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:14896:x1876527961730944:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 247us (7770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597039.588178:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:1.0:1789597039.603076:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597039.603374:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731072 00000100:00100000:3.0:1789597039.603390:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731072 00000100:00100000:3.0:1789597039.603510:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:3.0:1789597039.603523:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+13:14896:x1876527961731072:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597039.603844:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+13:14896:x1876527961731072:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 322us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597039.603854:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 155 00010000:00010000:0.0:1789597039.935792:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597040.120757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597040.120812:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597040.120884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597040.120911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597040.120912:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731200 00000100:00100000:0.0:1789597040.120927:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731200 00000100:00100000:3.0:1789597040.120929:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597040.120945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597040.120962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597040.120980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597040.120998:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:3.0:1789597040.121001:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597040.121010:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961731200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597040.121023:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731712 00000100:00100000:3.0:1789597040.121027:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731712 00000100:00100000:3.0:1789597040.121063:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732224 00000100:00100000:3.0:1789597040.121066:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732224 00000100:00100000:3.0:1789597040.121076:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731584 00000100:00100000:3.0:1789597040.121078:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731584 00000100:00100000:3.0:1789597040.121090:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732096 00000100:00100000:3.0:1789597040.121092:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732096 00000100:00100000:0.0:1789597040.121104:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961731200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597040.121106:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789597040.121113:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:3.0:1789597040.121115:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961731712:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597040.121145:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961731712:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.121150:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731456 00000100:00100000:3.0:1789597040.121151:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789597040.121153:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731456 00000100:00100000:3.0:1789597040.121171:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789597040.121177:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961732224:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597040.121190:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731968 00000100:00100000:0.0:1789597040.121193:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731968 00000100:00100000:0.0:1789597040.121204:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731328 00000100:00100000:0.0:1789597040.121207:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731328 00000100:00100000:3.0:1789597040.121213:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961732224:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.121219:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961731840 00000100:00100000:3.0:1789597040.121220:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789597040.121221:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961731840 00000100:00100000:3.0:1789597040.121230:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789597040.121235:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961731584:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597040.121243:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789597040.121248:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961731456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597040.121259:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961731584:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597040.121266:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789597040.121275:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961731456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597040.121276:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789597040.121282:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961732096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597040.121282:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789597040.121292:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789597040.121298:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961731968:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597040.121304:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961732096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597040.121310:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789597040.121317:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2408:x1876527961731968:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 19us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.121323:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789597040.121333:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789597040.121339:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961731328:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597040.121365:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961731328:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.121371:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789597040.121382:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789597040.121388:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2408:x1876527961731840:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597040.121406:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2408:x1876527961731840:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 19us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.121424:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00080000:0.0:1789597040.121604:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597040.121609:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597040.121612:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789597040.121614:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1789597040.253123:0:17043:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789597040.253137:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e875ed800 from 13 10000000:01000000:3.0:1789597040.253146:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597040.253229:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597040.253245:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597040.253261:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597040.253301:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984885888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789597040.255049:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597040.255583:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984885888 00000100:00100000:2.0:1789597040.255601:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984885888 00000100:00100000:2.0:1789597040.255778:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789597040.255793:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+20:17043:x1876527984885888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597040.255821:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597040.255846:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbffcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbffc4 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.255908:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbffcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbffc4 expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.255920:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbffcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbffc4 expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.255929:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da400, rc 0) 00000100:00100000:2.0:1789597040.256001:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984885888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597040.256007:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789597040.257017:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b76840 going to sleep for 11 seconds 00000100:00100000:3.0:1789597040.257068:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984885888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597040.257092:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597040.257102:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597040.257227:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597040.257285:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597040.257323:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b76840 going to sleep for 11 seconds 00000100:00100000:0.0:1789597040.257391:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886016 00000100:00100000:0.0:1789597040.257397:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886016 00000100:00100000:0.0:1789597040.257447:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789597040.257455:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984886016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.257614:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984886016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.257621:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789597040.257658:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84453480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597040.257718:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789597040.259925:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597040.259990:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb4659cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597040.260026:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886144 00000100:00100000:3.0:1789597040.260037:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886144 00000100:00100000:3.0:1789597040.260126:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789597040.260137:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984886144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597040.260311:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984886144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597040.260320:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789597040.261060:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789597040.264992:0:20144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789597040.266435:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789597040.266484:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789597040.266499:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597040.266516:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597040.266547:0:17043:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789597040.266552:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb75f4800 from 13 10000000:01000000:3.0:1789597040.266556:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597040.266632:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597040.266651:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597040.266666:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597040.266746:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789597040.266866:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597040.266929:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b76cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597040.266956:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886272 00000100:00100000:0.0:1789597040.266968:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886272 00000100:00100000:0.0:1789597040.267051:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789597040.267063:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+21:17043:x1876527984886272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597040.267084:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597040.267104:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bbffd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbffd2 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597040.267140:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bbffd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbffd2 expref: 22 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597040.267153:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bbffd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbffd2 expref: 22 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597040.267164:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5200, rc 0) 00000100:00100000:0.0:1789597040.267227:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984886272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.267236:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789597040.267273:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d84452680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597040.267294:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.267305:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597040.267386:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.267420:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597040.267452:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83252180 going to sleep for 11 seconds 00000100:00100000:0.0:1789597040.277540:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886400 00000100:00100000:0.0:1789597040.277561:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886400 00000100:00100000:0.0:1789597040.277654:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789597040.277669:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984886400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.277974:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984886400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (10552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.277983:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789597040.278073:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.278151:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.278374:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597040.278412:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886528 00000100:00100000:1.0:1789597040.278417:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886528 00000100:00100000:0.0:1789597040.278423:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699180 going to sleep for 11 seconds 00000100:00100000:1.0:1789597040.278456:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789597040.278465:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984886528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.278567:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984886528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.285044:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.290047:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000040:00080000:0.0:1789597040.293039:0:20145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789597040.293249:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789597040.293285:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789597040.293301:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.293316:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597040.293345:0:17043:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789597040.293349:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d8318b800 from 13 10000000:01000000:1.0:1789597040.293352:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789597040.293484:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.293494:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.293511:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597040.293546:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.293668:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597040.293746:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83252c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597040.294701:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886656 00000100:00100000:2.0:1789597040.294716:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886656 00000100:00100000:2.0:1789597040.294916:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789597040.294937:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+22:17043:x1876527984886656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597040.294961:0:17040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597040.294984:0:17040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bbffe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbffe0 expref: -99 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.295018:0:17040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bbffe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbffe0 expref: 23 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.295048:0:17040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bbffe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbffe0 expref: 23 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.295058:0:17040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dba00, rc 0) 00000100:00100000:2.0:1789597040.295152:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984886656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597040.299199:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789597040.299398:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597040.299601:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.299618:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597040.300048:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597040.300133:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597040.300199:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb4659e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597040.300348:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886784 00000100:00100000:1.0:1789597040.300359:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886784 00000100:00100000:1.0:1789597040.300437:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789597040.300448:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984886784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.300664:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984886784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597040.300673:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789597040.301039:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597040.301096:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789597040.301160:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597040.301201:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb4659e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597040.301507:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984886912 00000100:00100000:1.0:1789597040.301514:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984886912 00000100:00100000:1.0:1789597040.301564:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789597040.301572:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984886912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.301741:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984886912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597040.301756:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789597040.301872:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984886912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789597040.305437:0:20146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789597040.306707:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789597040.306749:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789597040.306765:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.306782:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597040.306804:0:17043:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789597040.306809:0:17043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7ebfae6000 from 13 10000000:01000000:1.0:1789597040.306813:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789597040.306868:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.306878:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.306890:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597040.306928:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984887040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.307034:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597040.307098:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83252180 going to sleep for 11 seconds 00000100:00100000:2.0:1789597040.307584:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887040 00000100:00100000:2.0:1789597040.307606:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887040 00000100:00100000:2.0:1789597040.307712:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789597040.307724:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+23:17043:x1876527984887040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597040.307742:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597040.307761:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dac00/0x7b5398e289bbfff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bbffee expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.307800:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dac00/0x7b5398e289bbfff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bbffee expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.307816:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dac00/0x7b5398e289bbfff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bbffee expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597040.307826:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dac00, rc 0) 00000100:00100000:2.0:1789597040.307895:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984887040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597040.307903:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789597040.308084:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984887040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597040.308108:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597040.308120:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597040.308220:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984887168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.308276:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597040.308316:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d826996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597040.308663:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887168 00000100:00100000:1.0:1789597040.308670:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887168 00000100:00100000:1.0:1789597040.308740:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789597040.308751:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984887168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597040.308919:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984887168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597040.308934:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789597040.309856:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984887168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.309920:0:17043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984887296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.309992:0:17043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597040.310029:0:17043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d826996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597040.310048:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887296 00000100:00100000:0.0:1789597040.310062:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887296 00000100:00100000:0.0:1789597040.310108:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789597040.310116:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984887296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789597040.311583:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:17043:x1876527984887296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597040.311606:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789597040.311741:0:17043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f66223a4-de53-4574-9339-460f93dd2c76:17043:1876527984887296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789597040.318317:0:20147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789597040.320238:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789597040.320290:0:17043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789597040.320306:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597040.320323:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597040.640806:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789597040.966075:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597041.084992:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789597041.085029:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984887424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597041.085152:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.085212:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984887552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597041.085219:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887424 00000100:00100000:2.0:1789597041.085232:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887424 00000100:00100000:1.0:1789597041.085235:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597041.085307:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887552 00000100:00100000:2.0:1789597041.085311:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887552 00000100:00100000:2.0:1789597041.085333:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597041.085346:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984887424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789597041.085391:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789597041.085459:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984887424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597041.085475:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597041.085497:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789597041.085527:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984887552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789597041.085538:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789597041.085561:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984887552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597041.085564:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984887424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597041.085567:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789597041.085578:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984887552:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789597041.085585:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597041.086366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984887680:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984888192:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086495:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984888704:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086571:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789597041.086578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984888064:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086624:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086656:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984888576:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086739:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984887808:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086767:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086789:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984888320:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086811:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.086833:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984888832:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.086866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597041.087062:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887680 00000100:00100000:0.0:1789597041.087071:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887680 00000100:00100000:0.0:1789597041.087130:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888064 00000100:00100000:0.0:1789597041.087133:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888064 00000100:00100000:0.0:1789597041.087150:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597041.087159:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984887680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.087238:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984887680:12345-0@lo:400:kworker.0 Request processed in 80us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.087247:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597041.087265:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789597041.087271:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984888064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.087301:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984888064:12345-0@lo:400:kworker.0 Request processed in 31us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.087307:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789597041.087433:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789597041.087441:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984887936:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.087470:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.087486:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984888448:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.087538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597041.087564:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888704 00000100:00100000:1.0:1789597041.087568:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888704 00000100:00100000:0.0:1789597041.087699:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888576 00000100:00100000:0.0:1789597041.087704:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888576 00000100:00100000:3.0:1789597041.087960:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888192 00000100:00100000:3.0:1789597041.087965:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888192 00000100:00100000:1.0:1789597041.088024:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888320 00000100:00100000:1.0:1789597041.088027:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888320 00000100:00100000:1.0:1789597041.088035:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888832 00000100:00100000:1.0:1789597041.088037:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888832 00000100:00080000:2.0:1789597041.088869:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789597041.088886:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789597041.088888:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789597041.089142:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887936 00000100:00100000:0.0:1789597041.089150:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887936 00000100:00100000:0.0:1789597041.089163:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984888448 00000100:00100000:0.0:1789597041.089181:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984888448 00000100:00100000:0.0:1789597041.089205:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789597041.089213:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984888704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.089307:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984888704:12345-0@lo:400:kworker.0 Request processed in 97us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.089313:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789597041.089328:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789597041.089331:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.089360:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984888320:12345-0@lo:400:kworker.0 Request processed in 29us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.089364:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789597041.089370:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789597041.089374:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984888576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.089392:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984888576:12345-0@lo:400:kworker.0 Request processed in 18us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.089396:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789597041.089402:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789597041.089406:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.089421:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984887936:12345-0@lo:400:kworker.0 Request processed in 16us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.089425:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789597041.089430:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789597041.089433:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597041.089449:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984888448:12345-0@lo:400:kworker.0 Request processed in 15us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597041.089459:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789597041.089898:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984887808 00000100:00100000:3.0:1789597041.089906:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984887808 00000100:00100000:3.0:1789597041.089940:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789597041.090013:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984888192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597041.090065:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984888192:12345-0@lo:400:kworker.0 Request processed in 57us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597041.090072:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789597041.090085:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789597041.090091:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984887808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597041.090120:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984887808:12345-0@lo:400:kworker.0 Request processed in 30us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597041.090134:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789597041.090719:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789597041.090724:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789597041.091087:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789597041.091094:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984888832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091148:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984888832:12345-0@lo:400:kworker.0 Request processed in 56us (4283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597041.091152:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789597041.091198:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984888064:0@lo:400:kworker.0 00010000:00080000:1.0:1789597041.091226:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d5880 x1876527984888576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597041.091235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984888576:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091245:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984887680:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984888192:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091264:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984888704:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091304:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984887936:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984888448:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091319:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984887808:0@lo:400:kworker.0 00000100:00100000:1.0:1789597041.091328:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984888320:0@lo:400:kworker.0 00010000:00080000:1.0:1789597041.091335:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d836d4e00 x1876527984888832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597041.091342:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984888832:0@lo:400:kworker.0 00010000:00010000:0.0:1789597041.981031:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597042.494880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.495038:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732352 00000100:00100000:0.0:1789597042.495054:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732352 00000100:00080000:2.0:1789597042.495228:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789597042.495290:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789597042.495305:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:15564:x1876527961732352:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597042.495335:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.495365:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bbfffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d90 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495463:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495480:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495499:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495517:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495524:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495531:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495666:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4600/0x7b5398e289bc0011 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495742:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4600/0x7b5398e289bc0011 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495749:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4600/0x7b5398e289bc0011 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.495789:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789597042.495794:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597042.495848:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4600/0x7b5398e289bc0011 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495860:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495868:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495875:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495881:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.495886:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495896:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495911:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789597042.495915:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.495922:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495938:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495957:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495964:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495970:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495976:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.495979:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495986:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.495994:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c7d8259cc00) 00010000:00010000:0.0:1789597042.495997:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.496000:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.496006:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc000a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.496052:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bbfffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d90 expref: 8 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.496086:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4600/0x7b5398e289bc0011 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d90 expref: 7 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.496094:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7d8259c000) 00010000:00010000:0.0:1789597042.496097:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789597042.496099:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4600, rc 0) 00000100:00100000:0.0:1789597042.498852:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:15564:x1876527961732352:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 3532us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597042.498868:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789597042.517160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.517362:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732480 00000100:00100000:1.0:1789597042.517380:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732480 00000100:00100000:1.0:1789597042.517476:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789597042.517488:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:15564:x1876527961732480:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789597042.517629:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:15564:x1876527961732480:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 143us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.517638:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789597042.536137:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.542439:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732736 00000100:00100000:0.0:1789597042.542470:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732736 00000100:00100000:0.0:1789597042.542600:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789597042.542623:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:15564:x1876527961732736:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597042.542658:0:18445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.542756:0:18445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0018 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d97 expref: -99 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.542876:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.542895:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.542909:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597042.546514:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1789597042.546758:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.546789:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.546807:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597042.547088:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732864 00010000:00010000:0.0:1789597042.547088:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4c00/0x7b5398e289bc002d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597042.547105:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732864 00010000:00010000:0.0:1789597042.547106:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4c00/0x7b5398e289bc002d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.547121:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4c00/0x7b5398e289bc002d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.547135:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000100:00100000:2.0:1789597042.547208:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789597042.547224:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+10:15570:x1876527961732864:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789597042.547252:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597042.547278:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc003b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07d9e expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.547339:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.547349:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.547357:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547361:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.547365:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.547376:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547388:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547424:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.547425:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547479:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547489:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547497:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547553:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547562:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547569:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547577:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597042.547582:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547589:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547601:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:2.0:1789597042.547605:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597042.547610:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547631:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547658:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547665:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547672:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547727:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597042.547731:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547738:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547746:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7eb65a2000) 00010000:00010000:2.0:1789597042.547749:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597042.547752:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547758:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0049 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547800:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc003b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d9e expref: 11 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547812:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:2.0:1789597042.547815:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597042.547826:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc003b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d9e expref: 11 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.547837:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00010000:00010000:0.0:1789597042.548049:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7d8259c000) 00010000:00010000:0.0:1789597042.548057:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.548066:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.548073:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc001f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597042.548088:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+10:15570:x1876527961732864:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 866us (1593us total) trans 0 rc 301/301 00010000:00010000:0.0:1789597042.548093:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597042.548102:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00010000:00010000:0.0:1789597042.548115:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.548126:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.548134:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.548138:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.548145:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.548157:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7d8259cc00) 00010000:00010000:0.0:1789597042.548160:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.548164:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.548186:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0026 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.554781:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0018 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d97 expref: 10 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.554825:0:18445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4c00/0x7b5398e289bc002d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d97 expref: 9 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.554836:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7d8259c500) 00010000:00010000:0.0:1789597042.554840:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.554844:0:18445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4c00, rc 0) 00000100:00100000:0.0:1789597042.554941:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:15564:x1876527961732736:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 12328us (18821us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789597042.554950:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789597042.557516:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597042.557950:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961732992 00000100:00100000:2.0:1789597042.557986:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961732992 00000100:00100000:2.0:1789597042.558091:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:2.0:1789597042.558107:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:15564:x1876527961732992:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789597042.558318:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:15564:x1876527961732992:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 214us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597042.558327:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789597042.565789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.565828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597042.565973:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961733248 00000100:00100000:3.0:1789597042.565995:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961733248 00000100:00100000:2.0:1789597042.566054:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961733120 00000100:00100000:2.0:1789597042.566061:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961733120 00000100:00100000:2.0:1789597042.566135:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789597042.566150:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:15570:x1876527961733120:12345-192.168.202.16@tcp:700:lfs.0 00000100:00100000:3.0:1789597042.566174:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789597042.566190:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:15564:x1876527961733248:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789597042.566310:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:15570:x1876527961733120:12345-192.168.202.16@tcp:700:lfs.0 Request processed in 164us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597042.566321:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000004:00080000:3.0:1789597042.570273:0:17046:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4025us 00000100:00080000:0.0:1789597042.572360:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597042.575293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.575507:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961733504 00000100:00100000:1.0:1789597042.575524:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961733504 00000100:00100000:1.0:1789597042.575623:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789597042.575638:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:15570:x1876527961733504:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:1.0:1789597042.575744:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597042.575786:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bbff69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d0b expref: 9 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.575816:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:1.0:1789597042.575823:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789597042.575934:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.575955:0:17048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 5 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.575966:0:17048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.576017:0:17048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 5 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.576035:0:17048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 5 pid: 17046 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597042.576054:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984888960:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789597042.576285:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351180 going to sleep for 11 seconds 00000100:00100000:1.0:1789597042.580862:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.580916:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961733632 00000100:00100000:1.0:1789597042.580931:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961733632 00010000:00010000:1.0:1789597042.581009:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 6 pid: 17046 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597042.581057:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789597042.581071:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961733632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597042.581092:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597042.581101:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 6 pid: 17046 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.581117:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 6 pid: 17046 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.581145:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:1.0:1789597042.581152:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.581164:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.581173:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.581200:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597042.581270:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961733632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 202us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.581294:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00010000:00010000:1.0:1789597042.581376:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bbffa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d7b expref: 5 pid: 17046 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597042.585136:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984888960:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597042.585185:0:17048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.585199:0:17048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.585206:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.585240:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.585269:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.585283:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789597042.586987:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789597042.594837:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.594870:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.594887:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789597042.596574:0:17048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094e154c7 reply state 000000000a3e7243 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596610:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596634:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:1.0:1789597042.596638:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789597042.596644:0:17048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789597042.596650:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789597042.596663:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596671:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596882:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596893:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789597042.596900:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596909:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.596997:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8259cb00) 00010000:00010000:1.0:1789597042.597001:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789597042.597008:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.597039:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0050 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789597042.597072:0:17048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094e154c7 reply state 000000000a3e7243 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.597082:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.597088:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7eb9a7f800) 00010000:00010000:1.0:1789597042.597091:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789597042.597093:0:17048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789597042.597991:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+10:15570:x1876527961733504:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 22346us (24363us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789597042.598005:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789597042.615464:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:15564:x1876527961733248:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 49267us (49622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597042.615480:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:1.0:1789597042.626398:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984889088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597042.626520:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597042.626607:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984889088 00000100:00100000:0.0:1789597042.626631:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984889088 00000100:00100000:0.0:1789597042.626954:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789597042.626965:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984889088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789597042.627002:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597042.627103:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984889088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597042.627127:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789597042.627309:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984889088:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789597042.685600:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789597042.692210:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.692486:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961733760 00000100:00100000:1.0:1789597042.692503:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961733760 00000100:00100000:2.0:1789597042.692594:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789597042.692609:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+10:15578:x1876527961733760:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:2.0:1789597042.693040:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597042.693079:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07da5 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.693258:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc006c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.693277:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc006c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.693291:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc006c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597042.693357:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789597042.693362:0:17047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597042.693491:0:17047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc006c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.693525:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07da5 expref: 12 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.693550:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc006c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07da5 expref: 11 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.693559:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:2.0:1789597042.693562:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789597042.693567:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db200, rc 0) 00000100:00100000:2.0:1789597042.694102:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+11:15578:x1876527961733760:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 1495us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597042.694113:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789597042.717072:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.717952:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961733888 00000100:00100000:1.0:1789597042.717972:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961733888 00000100:00100000:1.0:1789597042.718061:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789597042.718075:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:15579:x1876527961733888:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789597042.718112:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597042.718144:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07dac expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.719097:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bc007a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.719130:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bc007a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.719148:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bc007a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597042.719217:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789597042.719221:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789597042.720766:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bc007a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.721854:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dac expref: 7 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.721892:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bc007a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dac expref: 6 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.721905:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:1.0:1789597042.721908:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789597042.721913:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1600, rc 0) 00000100:00100000:1.0:1789597042.722155:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15579:x1876527961733888:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 4080us (5097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.722167:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789597042.728256:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.728348:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961734016 00000100:00100000:0.0:1789597042.728366:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961734016 00000100:00100000:0.0:1789597042.728587:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789597042.728602:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:15579:x1876527961734016:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597042.728648:0:18445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.728729:0:18445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07db3 expref: -99 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.728850:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.728870:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.728886:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.728901:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.728910:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.728916:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729052:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0096 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729088:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729096:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.729171:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789597042.729179:0:18445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597042.729210:0:18445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729226:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729234:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729242:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729249:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.729255:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729265:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729282:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:0.0:1789597042.729287:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.729295:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729314:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729333:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729340:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729347:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729353:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.729356:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729363:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729370:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7eb9a7f800) 00010000:00010000:0.0:1789597042.729373:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.729376:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729382:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc008f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729932:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07db3 expref: 8 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729974:0:18445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07db3 expref: 7 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.729984:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:0.0:1789597042.729987:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789597042.729990:0:18445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4000, rc 0) 00000100:00100000:0.0:1789597042.730100:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+7:15579:x1876527961734016:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1499us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597042.730111:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789597042.734014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.734789:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961734144 00000100:00100000:1.0:1789597042.734832:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961734144 00000100:00100000:1.0:1789597042.734944:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1789597042.734959:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:15579:x1876527961734144:12345-192.168.202.16@tcp:900:lfs.0 00000100:00100000:1.0:1789597042.735114:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:15579:x1876527961734144:12345-192.168.202.16@tcp:900:lfs.0 Request processed in 155us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.735123:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00080000:2.0:1789597042.735544:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789597042.740422:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.740533:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961734400 00000100:00100000:0.0:1789597042.740549:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961734400 00000100:00100000:0.0:1789597042.740642:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789597042.740655:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+7:15579:x1876527961734400:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597042.740737:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.740771:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc009d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07dba expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.740940:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789597042.741099:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc009d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dba expref: 9 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.741119:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:0.0:1789597042.741124:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789597042.741130:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc009d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dba expref: 9 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.741172:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5a00, rc 0) 00000100:00100000:0.0:1789597042.741261:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+8:15579:x1876527961734400:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 609us (859us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789597042.741271:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789597042.747221:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597042.747663:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961734656 00000100:00100000:2.0:1789597042.747842:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961734656 00000100:00100000:2.0:1789597042.747970:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:2.0:1789597042.747985:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+8:15579:x1876527961734656:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:2.0:1789597042.748092:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597042.748148:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0096 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07db3 expref: 8 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.748176:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:2.0:1789597042.748183:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789597042.748216:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.748236:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.748249:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789597042.748936:0:17047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005acd0fbd reply state 000000002b19d38d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.748959:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.748968:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:2.0:1789597042.748972:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789597042.748988:0:17047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789597042.749004:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789597042.749361:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+9:15579:x1876527961734656:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 1375us (2150us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789597042.749371:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1789597042.752454:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.756277:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961734912 00000100:00100000:1.0:1789597042.756309:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961734912 00000100:00100000:1.0:1789597042.756700:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789597042.756719:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+9:15579:x1876527961734912:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789597042.757124:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+10:15579:x1876527961734912:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 409us (4688us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789597042.757133:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789597042.760600:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.761097:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961735168 00000100:00100000:0.0:1789597042.761113:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961735168 00000100:00100000:0.0:1789597042.761206:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789597042.761221:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+10:15579:x1876527961735168:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597042.761258:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.761291:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07dc1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761539:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761561:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761577:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761591:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761598:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761605:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.761830:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789597042.761948:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761958:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761966:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761973:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.761980:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.761989:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762007:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:0.0:1789597042.762011:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.762018:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762025:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc00b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762041:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762048:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762067:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762073:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.762076:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762083:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762091:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7eb9a7f800) 00010000:00010000:0.0:1789597042.762094:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.762097:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762104:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc00c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762512:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc1 expref: 12 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762527:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:0.0:1789597042.762530:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789597042.762534:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc1 expref: 12 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.762551:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5a00, rc 0) 00000100:00100000:0.0:1789597042.762936:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+11:15579:x1876527961735168:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1716us (2349us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789597042.762961:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789597042.766554:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.766800:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961735296 00000100:00100000:0.0:1789597042.766816:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961735296 00000100:00100000:0.0:1789597042.766902:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789597042.766915:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+11:15579:x1876527961735296:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597042.766952:0:18445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.766982:0:18445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc00ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07dc8 expref: -99 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.767133:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.767168:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.767186:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.767222:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789597042.767227:0:18445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597042.767254:0:18445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.767291:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc00ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 13 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.767315:0:18445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 12 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.767354:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:0.0:1789597042.767358:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789597042.767363:0:18445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5000, rc 0) 00000100:00100000:0.0:1789597042.767452:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+12:15579:x1876527961735296:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 539us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597042.767459:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:3.0:1789597042.772076:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597042.772216:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961735424 00000100:00100000:2.0:1789597042.772233:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961735424 00000100:00100000:2.0:1789597042.772324:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789597042.772337:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+12:15579:x1876527961735424:12345-192.168.202.16@tcp:37:lfs.0 00000100:00100000:2.0:1789597042.777675:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+12:15579:x1876527961735424:12345-192.168.202.16@tcp:37:lfs.0 Request processed in 5321us (5601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597042.777727:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789597042.781946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.782109:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961735680 00000100:00100000:1.0:1789597042.782125:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961735680 00000100:00100000:1.0:1789597042.782223:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789597042.782237:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebf970c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+12:15579:x1876527961735680:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789597042.782631:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebf970c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+13:15579:x1876527961735680:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 394us (701us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789597042.782641:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789597042.847633:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597042.847967:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961735808 00000100:00100000:2.0:1789597042.847983:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961735808 00000100:00100000:2.0:1789597042.848082:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789597042.848098:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+11:15585:x1876527961735808:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789597042.848148:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597042.848185:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc00dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07dcf expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848291:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848308:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848324:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848366:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848374:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848381:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848528:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc00f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848538:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc00f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848545:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc00f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597042.848603:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789597042.848607:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597042.848745:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc00f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848765:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848773:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848781:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848801:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597042.848807:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848817:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848833:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:2.0:1789597042.848837:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597042.848843:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848850:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc00e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848866:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848872:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848878:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848883:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597042.848886:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848893:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848912:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7eb9a7f800) 00010000:00010000:2.0:1789597042.848915:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597042.848918:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848923:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc00ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848964:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc00dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dcf expref: 13 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848981:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc00f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dcf expref: 12 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597042.848989:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:2.0:1789597042.848992:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789597042.848995:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db800, rc 0) 00000100:00100000:2.0:1789597042.849102:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+12:15585:x1876527961735808:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1006us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597042.849112:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1789597042.853534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.854875:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961735936 00000100:00100000:1.0:1789597042.854894:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961735936 00000100:00100000:1.0:1789597042.855048:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789597042.855062:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:15585:x1876527961735936:12345-192.168.202.16@tcp:900:bash.0 00000100:00100000:1.0:1789597042.855213:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:15585:x1876527961735936:12345-192.168.202.16@tcp:900:bash.0 Request processed in 153us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.855244:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789597042.859412:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597042.859554:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961736192 00000100:00100000:0.0:1789597042.859581:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961736192 00000100:00100000:0.0:1789597042.860197:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789597042.860215:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb9918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+12:15585:x1876527961736192:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789597042.860264:0:18445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597042.860302:0:18445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc00f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07dd6 expref: -99 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.860481:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.860516:0:18445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 12 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.860527:0:18445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.860588:0:18445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 12 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.860606:0:18445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 12 pid: 18445 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597042.860666:0:18445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18445:1876527984889216:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789597042.860832:0:18445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789597042.866004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.866147:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961736320 00000100:00100000:1.0:1789597042.866162:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961736320 00010000:00010000:1.0:1789597042.866222:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 13 pid: 18445 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597042.866283:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789597042.866294:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+13:2409:x1876527961736320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597042.866314:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597042.866322:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 13 pid: 18445 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.866336:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 13 pid: 18445 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.866366:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:1.0:1789597042.866372:0:17032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.866385:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.866396:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.866419:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597042.866496:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+13:2409:x1876527961736320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 202us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.866527:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00010000:00010000:0.0:1789597042.867528:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc00d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dc8 expref: 12 pid: 18445 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597042.867561:0:18445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18445:1876527984889216:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789597042.867598:0:18445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.867620:0:18445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.867627:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.867663:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.867753:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.867765:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.868950:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.868974:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869009:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597042.869026:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789597042.869066:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869075:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869082:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869089:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597042.869094:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869102:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869117:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:0.0:1789597042.869120:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597042.869126:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869132:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc00ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789597042.869657:0:18445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dd6a884 reply state 00000000346e5636 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869722:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869729:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c7d8259cc00) 00010000:00010000:0.0:1789597042.869732:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789597042.869737:0:18445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789597042.869797:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc00f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 15 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869815:0:18445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 14 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597042.869825:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597042.869828:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789597042.869830:0:18445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4a00, rc 0) 00000100:00100000:0.0:1789597042.870020:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb9918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+15:15585:x1876527961736192:12345-192.168.202.16@tcp:101:bash.0 Request processed in 9810us (10633us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789597042.870029:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1789597042.891945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.892230:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961736448 00000100:00100000:1.0:1789597042.892324:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961736448 00000100:00100000:1.0:1789597042.892575:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1789597042.892591:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+15:15585:x1876527961736448:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789597042.892644:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597042.892718:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81510e00/0x7b5398e289bc011b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ddd expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.892830:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.892849:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.892865:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597042.892955:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789597042.892962:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789597042.892996:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.893011:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.893043:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81510e00/0x7b5398e289bc011b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 17 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.893070:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 16 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597042.893103:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597042.893107:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789597042.893113:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1800, rc 0) 00000100:00100000:1.0:1789597042.893340:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:15585:x1876527961736448:12345-192.168.202.16@tcp:101:bash.0 Request processed in 751us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597042.893349:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:3.0:1789597042.899935:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597042.900037:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961736704 00000100:00100000:1.0:1789597042.900051:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961736704 00000100:00100000:1.0:1789597042.900128:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789597042.900152:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:15585:x1876527961736704:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:1.0:1789597042.900943:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+17:15585:x1876527961736704:12345-192.168.202.16@tcp:35:bash.0 Request processed in 800us (1019us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789597042.900953:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00010000:00010000:3.0:1789597043.005540:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597043.034756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597043.034993:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961736960 00000100:00100000:2.0:1789597043.035009:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961736960 00000100:00100000:2.0:1789597043.035088:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789597043.035104:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+17:15595:x1876527961736960:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789597043.035158:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597043.035216:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07de4 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597043.035361:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789597043.035515:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0129 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07de4 expref: 19 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.035533:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:2.0:1789597043.035537:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789597043.035544:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07de4 expref: 19 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.035826:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da000, rc 0) 00000100:00100000:2.0:1789597043.035923:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+18:15595:x1876527961736960:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 822us (1183us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789597043.035932:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789597043.055373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597043.056107:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961737216 00000100:00100000:2.0:1789597043.056126:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961737216 00000100:00100000:2.0:1789597043.056224:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1789597043.056238:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+18:15595:x1876527961737216:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789597043.056598:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+19:15595:x1876527961737216:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 362us (1243us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789597043.056608:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789597043.115052:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597043.115198:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961737472 00000100:00100000:0.0:1789597043.115215:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961737472 00000100:00100000:0.0:1789597043.115300:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:0.0:1789597043.115311:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+19:15598:x1876527961737472:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597043.115347:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597043.115376:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc0137 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07deb expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.115554:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc013e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.116055:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc013e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.116074:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc013e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597043.116093:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789597043.116439:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc0137 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07deb expref: 22 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.116473:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc013e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07deb expref: 21 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.116485:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597043.116488:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789597043.116494:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5a00, rc 0) 00000100:00100000:0.0:1789597043.116916:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+21:15598:x1876527961737472:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1602us (1873us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789597043.116927:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789597043.122650:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597043.122887:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961737600 00000100:00100000:2.0:1789597043.122903:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961737600 00000100:00100000:2.0:1789597043.122994:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789597043.123008:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+21:15598:x1876527961737600:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789597043.123149:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123175:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123191:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123257:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123265:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123273:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123281:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597043.123286:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123296:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123310:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:2.0:1789597043.123314:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789597043.123320:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597043.123327:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc014c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597043.130997:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+21:15598:x1876527961737600:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 7966us (8340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597043.131023:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789597043.136310:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597043.136445:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597043.136800:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961737984 00000100:00100000:2.0:1789597043.136815:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961737984 00000100:00100000:2.0:1789597043.136890:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789597043.136904:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+21:15598:x1876527961737984:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789597043.137252:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+22:15598:x1876527961737984:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 350us (805us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789597043.137261:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789597043.147378:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961737728 00000100:00100000:1.0:1789597043.147899:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961737728 00000100:00100000:1.0:1789597043.148018:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789597043.148031:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+22:2408:x1876527961737728:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597043.148086:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597043.148124:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc013e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07deb expref: 22 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.149432:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597043.149444:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597043.149548:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+21:2408:x1876527961737728:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1515us (13250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597043.149588:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789597043.432898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597043.433083:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961738240 00000100:00100000:1.0:1789597043.433101:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961738240 00000100:00100000:1.0:1789597043.433193:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1789597043.433205:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+21:15629:x1876527961738240:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1789597043.433242:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597043.433273:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81510e00/0x7b5398e289bc0153 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07df2 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.433422:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc015a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.433441:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc015a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.433460:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc015a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597043.433474:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789597043.433664:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e81510e00/0x7b5398e289bc0153 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07df2 expref: 24 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.433736:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc015a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07df2 expref: 23 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.433746:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597043.433750:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789597043.433754:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743a00, rc 0) 00000100:00100000:1.0:1789597043.433857:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+23:15629:x1876527961738240:12345-192.168.202.16@tcp:101:cat.0 Request processed in 654us (974us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789597043.433865:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789597043.440457:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597043.440540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597043.440732:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961738496 00000100:00100000:2.0:1789597043.440748:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961738496 00000100:00100000:2.0:1789597043.440830:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789597043.440842:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+23:15629:x1876527961738496:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789597043.441244:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+24:15629:x1876527961738496:12345-192.168.202.16@tcp:35:cat.0 Request processed in 403us (805us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789597043.441253:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1789597043.447501:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961738624 00000100:00100000:1.0:1789597043.447529:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961738624 00000100:00100000:1.0:1789597043.447999:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1789597043.448013:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+24:2407:x1876527961738624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597043.448036:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597043.448075:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc015a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07df2 expref: 24 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.448107:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597043.448115:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597043.448221:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+23:2407:x1876527961738624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 210us (7679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597043.448230:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000040:00080000:1.0:1789597043.520115:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789597043.529380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597043.538207:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961738880 00000100:00100000:0.0:1789597043.538231:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961738880 00000100:00100000:0.0:1789597043.538332:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789597043.538346:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+23:15635:x1876527961738880:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789597043.538376:0:18445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597043.538404:0:18445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0168 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07df9 expref: -99 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538568:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538585:0:18445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 24 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538593:0:18445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 24 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538600:0:18445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538648:0:18445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 24 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538662:0:18445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 24 pid: 17048 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597043.538698:0:18445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18445:1876527984889344:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789597043.538804:0:18445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 24 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.538814:0:18445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 24 pid: 18445 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597043.538822:0:18445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18445:1876527984889472:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789597043.538875:0:18445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928900 going to sleep for 11 seconds 00000100:00100000:3.0:1789597043.542464:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597043.542509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597043.542547:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961739008 00000100:00100000:3.0:1789597043.542559:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961739008 00010000:00010000:3.0:1789597043.542628:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 25 pid: 17048 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597043.542673:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961739136 00000100:00100000:3.0:1789597043.542712:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961739136 00010000:00010000:3.0:1789597043.542729:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 26 pid: 18445 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597043.542754:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789597043.542765:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+26:2408:x1876527961739008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597043.542787:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597043.542796:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 26 pid: 17048 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.542813:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 26 pid: 17048 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.542845:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:3.0:1789597043.542851:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.542863:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.542898:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597043.542970:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+26:2408:x1876527961739008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 206us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597043.542978:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789597043.543002:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789597043.543008:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+25:2408:x1876527961739136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597043.543019:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597043.543024:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 25 pid: 18445 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.543033:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 25 pid: 18445 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.543046:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:3.0:1789597043.543049:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.543058:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.543066:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597043.543087:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597043.543105:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+25:2408:x1876527961739136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 97us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597043.543111:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00010000:00010000:1.0:1789597043.543520:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0122 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ddd expref: 24 pid: 17048 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597043.543543:0:18445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18445:1876527984889344:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597043.543557:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc010d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dd6 expref: 23 pid: 18445 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597043.543568:0:18445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18445:1876527984889472:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597043.543600:0:18445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.543635:0:18445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.543641:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597043.543667:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789597043.543893:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0168 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07df9 expref: 24 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.543910:0:18445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07df9 expref: 23 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.543918:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597043.543921:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789597043.543924:0:18445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4400, rc 0) 00000100:00100000:1.0:1789597043.543974:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+23:15635:x1876527961738880:12345-192.168.202.16@tcp:101:dd.0 Request processed in 5631us (14608us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789597043.543983:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1789597043.554450:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597043.558484:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961739264 00000100:00100000:1.0:1789597043.558507:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961739264 00000100:00100000:1.0:1789597043.558890:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1789597043.558905:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+23:15635:x1876527961739264:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1789597043.558948:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597043.558984:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc017d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e00 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.559065:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.559084:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.559103:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.559276:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc017d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 25 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.559304:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 24 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.559314:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597043.559319:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789597043.559323:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742e00, rc 0) 00000100:00100000:1.0:1789597043.559440:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+24:15635:x1876527961739264:12345-192.168.202.16@tcp:101:dd.0 Request processed in 538us (5007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597043.559448:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789597043.563894:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597043.569262:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961739520 00000100:00100000:0.0:1789597043.569290:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961739520 00000100:00100000:0.0:1789597043.569494:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789597043.569508:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+24:15635:x1876527961739520:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:0.0:1789597043.569946:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.569970:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.569987:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789597043.570044:0:17046:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789597043.570071:0:17046:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cc211a7 reply state 000000002d12d085 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.570088:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.570097:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597043.570101:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789597043.570106:0:17046:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789597043.571451:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+27:15635:x1876527961739520:12345-192.168.202.16@tcp:36:dd.0 Request processed in 1853us (7480us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789597043.571472:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000020:00080000:0.0:1789597043.571481:0:17046:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789597043.575327:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597043.575775:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961739648 00000100:00100000:0.0:1789597043.575793:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961739648 00000100:00100000:0.0:1789597043.575897:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789597043.575910:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+27:15635:x1876527961739648:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789597043.575946:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597043.575977:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc0192 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e07 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.576079:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc0192 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e07 expref: 28 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.576099:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc0192 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e07 expref: 28 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.576140:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597043.576145:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789597043.576151:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5800, rc 0) 00000100:00100000:0.0:1789597043.576253:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15635:x1876527961739648:12345-192.168.202.16@tcp:101:dd.0 Request processed in 344us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597043.576261:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789597043.596335:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597043.596492:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961739904 00000100:00100000:1.0:1789597043.596505:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961739904 00000100:00100000:1.0:1789597043.596613:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789597043.596627:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15635:x1876527961739904:12345-192.168.202.16@tcp:103:dd.0 00010000:00010000:1.0:1789597043.596649:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597043.596740:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc0192 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e07 expref: 28 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.596790:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597043.596798:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597043.596880:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+27:15635:x1876527961739904:12345-192.168.202.16@tcp:103:dd.0 Request processed in 256us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597043.596888:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789597043.602236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597043.602581:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961740032 00000100:00100000:1.0:1789597043.602595:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961740032 00000100:00100000:1.0:1789597043.602731:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1789597043.602745:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+27:15635:x1876527961740032:12345-192.168.202.16@tcp:58:dd.0 00010000:00010000:1.0:1789597043.602915:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.602938:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597043.602954:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789597043.608096:0:17048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789597043.617292:0:17048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789597043.617597:0:17048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789597043.617815:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+27:15635:x1876527961740032:12345-192.168.202.16@tcp:58:dd.0 Request processed in 15064us (15589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597043.617832:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789597043.621079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597043.621183:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961740160 00000100:00100000:0.0:1789597043.621201:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961740160 00000100:00100000:0.0:1789597043.621296:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:0.0:1789597043.621310:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+27:15635:x1876527961740160:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789597043.621371:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597043.621409:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e0e expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.621508:0:17046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.621523:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 28 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.621552:0:17046:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.622036:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 28 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.622058:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597043.622062:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789597043.622066:0:17046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 28 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597043.622076:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5800, rc 0) 00000100:00100000:0.0:1789597043.622259:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15635:x1876527961740160:12345-192.168.202.16@tcp:101:dd.0 Request processed in 951us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597043.622269:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00010000:00010000:0.0:1789597044.029725:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789597044.541024:0:17082:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789597044.541040:0:17082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789597044.541114:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789597044.541128:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789597044.541382:0:17082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17082:1876527984889600:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789597044.541536:0:17082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351900 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.544383:0:17082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17082:1876527984889600:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789597044.550877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.551529:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961740288 00000100:00100000:2.0:1789597044.551553:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961740288 00000100:00100000:2.0:1789597044.551740:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789597044.551758:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15636:x1876527961740288:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789597044.551832:0:17047:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789597044.552035:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15636:x1876527961740288:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 281us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597044.552045:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00080000:1.0:1789597044.552565:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597044.569839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597044.570166:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961740416 00000100:00100000:1.0:1789597044.570186:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961740416 00000100:00100000:1.0:1789597044.570275:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789597044.570288:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15636:x1876527961740416:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789597044.570405:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.570428:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.570447:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572315:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572342:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572358:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572394:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572404:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572411:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597044.572618:0:18445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789597044.572639:0:18445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789597044.572658:0:18445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572672:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572706:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572714:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572720:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789597044.572725:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572734:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572749:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7d8259c500) 00010000:00010000:1.0:1789597044.572752:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789597044.572759:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572765:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc01a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572785:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572792:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572809:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572815:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789597044.572819:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572826:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572834:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c7eb9a7f900) 00010000:00010000:1.0:1789597044.572837:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789597044.572840:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.572846:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742a00/0x7b5398e289bc01ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573613:0:18445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573621:0:18445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573628:0:18445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573634:0:18445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789597044.573637:0:18445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573663:0:18445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573675:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:1.0:1789597044.573829:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789597044.573835:0:18445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.573842:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc01b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597044.573980:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15636:x1876527961740416:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 3688us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597044.573991:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:3.0:1789597044.580607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.580758:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961740672 00000100:00100000:2.0:1789597044.580779:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961740672 00000100:00100000:2.0:1789597044.580878:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789597044.580890:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+28:15636:x1876527961740672:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789597044.581130:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597044.581156:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da600/0x7b5398e289bc01bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e15 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581366:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581385:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581399:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597044.581413:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789597044.581505:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581513:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581541:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581547:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.581552:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581560:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581573:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:2.0:1789597044.581577:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789597044.581582:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581588:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581670:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da600/0x7b5398e289bc01bc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e15 expref: 30 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581709:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7d8259c500) 00010000:00010000:2.0:1789597044.581711:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789597044.581716:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da600/0x7b5398e289bc01bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e15 expref: 30 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.581726:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da600, rc 0) 00000100:00100000:2.0:1789597044.581866:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+29:15636:x1876527961740672:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 977us (1283us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789597044.581883:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1789597044.595497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.595941:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961740800 00000100:00100000:0.0:1789597044.595960:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961740800 00000100:00100000:0.0:1789597044.596083:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789597044.596095:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+29:15636:x1876527961740800:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789597044.596167:0:17046:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789597044.596358:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+29:15636:x1876527961740800:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 264us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.596366:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789597044.604963:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.605199:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961741056 00000100:00100000:2.0:1789597044.605216:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961741056 00000100:00100000:2.0:1789597044.605314:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789597044.605326:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+29:15636:x1876527961741056:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789597044.605352:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597044.605376:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da600/0x7b5398e289bc01d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e1c expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789597044.605902:0:17048:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1789597044.605920:0:17048:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789597044.605942:0:17048:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789597044.606079:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.606096:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.606111:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.606162:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da600/0x7b5398e289bc01d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e1c expref: 32 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.606180:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e1c expref: 31 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.606190:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7eb65a2200) 00010000:00010000:2.0:1789597044.606207:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789597044.606211:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dae00, rc 0) 00000100:00100000:2.0:1789597044.606276:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+31:15636:x1876527961741056:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 952us (1335us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789597044.606284:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789597044.622543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.622828:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961741312 00000100:00100000:0.0:1789597044.622848:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961741312 00000100:00100000:0.0:1789597044.622953:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:0.0:1789597044.622969:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+31:15636:x1876527961741312:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789597044.623070:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597044.623111:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc01d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e1c expref: 31 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.623139:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7eb65a2200) 00010000:00010000:0.0:1789597044.623153:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789597044.623187:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.623205:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.623218:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.627982:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628034:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628051:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628112:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628133:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628141:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628148:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597044.628154:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628164:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628177:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:0.0:1789597044.628181:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597044.628287:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628296:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc01e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628314:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628330:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628337:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628342:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597044.628345:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628352:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628362:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4eb4cad7 (ffff9c7d8259cb00) 00010000:00010000:0.0:1789597044.628365:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597044.628367:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.628373:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc01ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4eb4cad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597044.628834:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+30:15636:x1876527961741312:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 5862us (6297us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789597044.628845:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789597044.633400:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.633571:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961741440 00000100:00100000:0.0:1789597044.633583:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961741440 00000100:00100000:0.0:1789597044.633769:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789597044.633784:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+30:15636:x1876527961741440:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597044.633809:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597044.633870:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc01f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e23 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.633914:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc01fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.633930:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc01fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.633945:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc01fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.634082:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5000/0x7b5398e289bc01f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e23 expref: 32 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.634105:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc01fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e23 expref: 31 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.634114:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:0.0:1789597044.634118:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789597044.634133:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5600, rc 0) 00000100:00100000:0.0:1789597044.634227:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+31:15636:x1876527961741440:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 445us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.634235:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:2.0:1789597044.640030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597044.640143:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961741696 00000100:00100000:1.0:1789597044.640156:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961741696 00000100:00100000:1.0:1789597044.640231:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:1.0:1789597044.640243:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+31:15636:x1876527961741696:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789597044.640334:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.640356:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.640370:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789597044.640579:0:18445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789597044.640590:0:18445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 619458909982ns, next at 620458907679ns, rc = 0 00000004:00010000:1.0:1789597044.640707:0:18445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c522205 reply state 00000000482e8a33 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.640721:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.640730:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:1.0:1789597044.640733:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789597044.640737:0:18445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789597044.641217:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+33:15636:x1876527961741696:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 971us (1195us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789597044.641226:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789597044.652480:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.652860:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961741824 00000100:00100000:2.0:1789597044.652874:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961741824 00000100:00100000:2.0:1789597044.652942:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1789597044.652954:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+33:15636:x1876527961741824:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789597044.652985:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597044.653012:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e2a expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.653088:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 34 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.653105:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 34 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.653139:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:2.0:1789597044.653143:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789597044.653147:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da200, rc 0) 00000100:00100000:2.0:1789597044.653558:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+34:15636:x1876527961741824:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 604us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597044.653567:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1789597044.663105:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.664033:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961741952 00000100:00100000:0.0:1789597044.664049:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961741952 00000100:00100000:1.0:1789597044.664413:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:1.0:1789597044.664428:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2408:x1876527961741952:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789597044.664755:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961741952:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 331us (1657us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789597044.664765:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00080000:2.0:1789597044.665784:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597044.668916:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597044.668943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984889728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597044.669029:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597044.669091:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984889728 00000100:00100000:1.0:1789597044.669099:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984889728 00000100:00100000:1.0:1789597044.669163:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789597044.669172:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984889728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597044.669423:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597044.669476:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984889728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 305us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597044.669499:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789597044.669549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e92d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984889728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597044.669947:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789597044.669964:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984889856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597044.670016:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597044.670112:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984889856 00000100:00100000:3.0:1789597044.670127:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984889856 00000100:00100000:3.0:1789597044.670194:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789597044.670203:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984889856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789597044.670230:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597044.670272:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984889856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.670279:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789597044.670318:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984889856:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789597044.670567:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597044.670841:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d836d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984889984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597044.670879:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597044.671011:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984889984 00000100:00100000:0.0:1789597044.671017:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984889984 00000100:00100000:0.0:1789597044.671058:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789597044.671065:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984889984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597044.671093:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789597044.671142:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984889984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.671149:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789597044.671546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d836d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984889984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597044.673791:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.673907:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961742208 00000100:00100000:2.0:1789597044.673921:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961742208 00000100:00100000:2.0:1789597044.673977:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789597044.673988:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+34:15636:x1876527961742208:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789597044.674327:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+35:15636:x1876527961742208:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 340us (546us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789597044.674335:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789597044.677875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.678218:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961742464 00000100:00100000:3.0:1789597044.678228:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961742464 00000100:00100000:3.0:1789597044.678294:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789597044.678303:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+35:15636:x1876527961742464:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789597044.678437:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+35:15636:x1876527961742464:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 135us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.678444:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789597044.682009:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.682159:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961742592 00000100:00100000:0.0:1789597044.682171:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961742592 00000100:00100000:0.0:1789597044.682358:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789597044.682379:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+35:15636:x1876527961742592:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597044.682407:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597044.682433:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0210 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e31 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.682546:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc0217 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.682563:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc0217 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.682575:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc0217 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597044.682633:0:17047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597044.682654:0:17047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc0217 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.682745:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0210 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e31 expref: 37 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.682771:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc0217 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e31 expref: 36 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.682782:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:0.0:1789597044.682786:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789597044.682791:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4a00, rc 0) 00000100:00100000:0.0:1789597044.682883:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+36:15636:x1876527961742592:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 515us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.682891:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789597044.689065:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.689348:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961742720 00000100:00100000:3.0:1789597044.689361:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961742720 00000100:00100000:3.0:1789597044.689441:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:3.0:1789597044.689453:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2409:x1876527961742720:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789597044.689475:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597044.689497:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e38 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597044.689525:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab1575, blocks: 0x0 00010000:00010000:3.0:1789597044.689546:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=619s v=(0 0) 00010000:00010000:3.0:1789597044.689550:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597044.689560:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 7 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.689579:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 7 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.689592:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031200, rc 0) 00000100:00100000:3.0:1789597044.689768:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2409:x1876527961742720:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 317us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.689775:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1789597044.700883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.700967:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961742976 00000100:00100000:3.0:1789597044.700981:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961742976 00000100:00100000:3.0:1789597044.701041:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789597044.701051:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+36:15636:x1876527961742976:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789597044.701435:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+36:15636:x1876527961742976:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 383us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.701444:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789597044.707965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.708058:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961743104 00000100:00100000:2.0:1789597044.708069:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961743104 00000100:00100000:2.0:1789597044.708137:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789597044.708147:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+36:15636:x1876527961743104:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789597044.712980:0:17026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789597044.713002:0:17026:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789597044.713063:0:17026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1789597044.713487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984890112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789597044.713566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789597044.713779:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713793:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713801:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713807:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.713811:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713837:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713855:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7eb9a7f800) 00010000:00010000:2.0:1789597044.713858:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597044.713864:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713869:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0057 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713894:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713900:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713905:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713910:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.713913:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713918:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713926:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:2.0:1789597044.713928:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597044.713931:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713943:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc005e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713956:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713963:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713969:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713974:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.713977:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713983:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.713991:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c7d8259cc00) 00010000:00010000:2.0:1789597044.713993:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597044.713996:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714002:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0106 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714016:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714022:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714034:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714039:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.714042:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714048:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714056:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:2.0:1789597044.714058:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597044.714061:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714067:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc018b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714080:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714086:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714091:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714095:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.714097:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714111:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714244:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:2.0:1789597044.714247:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789597044.714252:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.714258:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742200/0x7b5398e289bc0202 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.714515:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+15:15636:x1876527961743104:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 6365us (6555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597044.714527:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:3.0:1789597044.714623:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984890112 00000100:00100000:3.0:1789597044.714632:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984890112 00000100:00100000:3.0:1789597044.714734:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789597044.714744:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984890112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789597044.714880:0:18554:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789597044.714885:0:18554:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789597044.714887:0:18554:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789597044.714889:0:18554:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789597045 -> 1789597045 00002000:00010000:3.0:1789597044.714892:0:18554:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789597044.714947:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984890112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (1380us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789597044.714954:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:3.0:1789597044.715008:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7e869bca80/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789597044.715015:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984890112:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789597044.715133:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.715141:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.715147:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.715152:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597044.715156:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.715162:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.715196:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:0.0:1789597044.715199:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789597044.715202:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.715207:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc00ab lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789597044.715424:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597044.721358:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.721485:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961743232 00000100:00100000:3.0:1789597044.721496:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961743232 00000100:00100000:3.0:1789597044.721602:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:3.0:1789597044.721614:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2409:x1876527961743232:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789597044.721783:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2409:x1876527961743232:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 171us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.721789:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789597044.728030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.728291:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961743488 00000100:00100000:0.0:1789597044.728301:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961743488 00000100:00100000:0.0:1789597044.728500:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1789597044.728513:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+15:15636:x1876527961743488:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789597044.728578:0:18445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597044.728631:0:18445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc0217 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e31 expref: 15 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.728656:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:0.0:1789597044.728662:0:18445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789597044.728729:0:18445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.728747:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.728757:0:18445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789597044.728924:0:18445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0a1de09 reply state 000000005cb39052 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.728958:0:18445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.728965:0:18445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:0.0:1789597044.728967:0:18445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789597044.728970:0:18445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789597044.729101:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:15636:x1876527961743488:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 590us (1084us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789597044.729109:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:1.0:1789597044.733460:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.733620:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961743616 00000100:00100000:3.0:1789597044.733641:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961743616 00000100:00100000:3.0:1789597044.733724:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789597044.733735:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:15636:x1876527961743616:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789597044.733754:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597044.733772:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e3f expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.733823:0:18554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 8 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.733832:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597044.733837:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597044.733841:0:18554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.733892:0:18554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 8 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.733907:0:18554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 8 pid: 18556 timeout: 719 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597044.733935:0:18554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18554:1876527984890240:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789597044.734022:0:18554:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b76e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.739739:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.739983:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961743744 00000100:00100000:2.0:1789597044.739993:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961743744 00010000:00010000:2.0:1789597044.740034:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 9 pid: 18556 timeout: 719 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.740077:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789597044.740087:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:2409:x1876527961743744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597044.740102:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597044.740137:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 9 pid: 18556 timeout: 719 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.740151:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 9 pid: 18556 timeout: 719 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.740202:0:17031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597044.740207:0:17031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597044.740214:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 9 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.740225:0:17031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 9 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.740265:0:17031:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 9 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.740281:0:17031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17031:1876527984890368:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789597044.740365:0:17031:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825ae6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789597044.743077:0:18554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071726813/0x7b5398e289bc021e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e38 expref: 9 pid: 18556 timeout: 719 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597044.743141:0:18554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18554:1876527984890240:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789597044.743178:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.743204:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031c00, rc 0) 00000100:00100000:0.0:1789597044.743526:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+8:15636:x1876527961743616:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 9791us (10070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.743536:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789597044.744446:0:17031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17031:1876527984890368:192.168.202.16@tcp:105: 00010000:00010000:3.0:1789597044.744871:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597044.744983:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2409:x1876527961743744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4894us (5250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.744996:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789597044.752618:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.754201:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961743872 00000100:00100000:3.0:1789597044.754216:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961743872 00000100:00100000:3.0:1789597044.754284:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1789597044.754294:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2408:x1876527961743872:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789597044.754746:0:18557:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789597044.754752:0:18557:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789597044 00002000:00010000:3.0:1789597044.754754:0:18557:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789597043 00002000:00010000:3.0:1789597044.754757:0:18557:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789597045 -> 1789597044 00002000:00010000:3.0:1789597044.754759:0:18557:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789597044.754843:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+8:2408:x1876527961743872:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 549us (2236us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789597044.754852:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789597044.759913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597044.760013:0:19208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744000 00000100:00100000:1.0:1789597044.760023:0:19208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744000 00000100:00100000:1.0:1789597044.760113:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1789597044.760134:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+8:2409:x1876527961744000:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789597044.760195:0:19208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.760218:0:19208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.760227:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597044.760231:0:19208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789597044.760237:0:19208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.760291:0:19208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.760307:0:19208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 8 pid: 18554 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597044.760322:0:19208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19208:1876527984890496:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789597044.760424:0:19208:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351900 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.767058:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.767168:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744128 00000100:00100000:2.0:1789597044.767180:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744128 00010000:00010000:2.0:1789597044.767243:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 9 pid: 18554 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.767296:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789597044.767307:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:2408:x1876527961744128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597044.767327:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597044.767355:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 9 pid: 18554 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.767395:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 9 pid: 18554 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.767429:0:17033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789597044.767435:0:17033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789597044.767441:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.767455:0:17033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.767485:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597044.767560:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+9:2408:x1876527961744128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 255us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597044.767569:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00010000:00010000:3.0:1789597044.769825:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb12031/0x7b5398e289bc022c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e3f expref: 8 pid: 18554 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597044.769877:0:19208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19208:1876527984890496:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789597044.769908:0:19208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770047:0:19208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770058:0:19208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770109:0:19208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770119:0:19208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770136:0:19208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770151:0:19208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597044.770155:0:19208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770165:0:19208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770562:0:19208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.770574:0:19208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea56eb9a/0x7b5398e289bc0233 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597044.770790:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+7:2409:x1876527961744000:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 10664us (10883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.770801:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1789597044.778272:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.778470:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744384 00000100:00100000:3.0:1789597044.778484:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744384 00000100:00100000:3.0:1789597044.778554:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1789597044.778565:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:15636:x1876527961744384:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789597044.778737:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.778764:0:17048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 16 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.778777:0:17048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.778823:0:17048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 16 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.778838:0:17048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 16 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597044.778856:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984890624:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789597044.778959:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b76e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789597044.782806:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984890624:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789597044.782846:0:17048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597044.784018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.784583:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744512 00000100:00100000:0.0:1789597044.784606:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744512 00010000:00010000:0.0:1789597044.784668:0:18581:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597044.784751:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789597044.784763:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+17:2408:x1876527961744512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789597044.784777:0:18581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597044.784799:0:18581:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.784812:0:18581:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.784835:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742e00/0x7b5398e289bc0184 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e00 expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.784852:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597044.784858:0:18581:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 16 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.784869:0:18581:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.784876:0:18581:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.784884:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.785079:0:18581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789597044.785151:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:2408:x1876527961744512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 390us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.785159:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00010000:00010000:2.0:1789597044.786893:0:17048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.786916:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.787334:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.787361:0:17048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 16 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.787439:0:17048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.787481:0:17048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 16 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.787497:0:17048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 16 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.787516:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984890752:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789597044.787846:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.793759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597044.793903:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744640 00000100:00100000:3.0:1789597044.793916:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744640 00010000:00010000:3.0:1789597044.793965:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597044.794008:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789597044.794018:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+17:2409:x1876527961744640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597044.794039:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597044.794047:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.794061:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 17 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.794091:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:3.0:1789597044.794097:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.794108:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.794123:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.794146:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597044.794221:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+17:2409:x1876527961744640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 203us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597044.794229:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00010000:00010000:2.0:1789597044.796456:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0209 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e2a expref: 16 pid: 17048 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.796487:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984890752:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789597044.796512:0:17048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.796523:0:17048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.796529:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789597044.796961:0:17048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789597044.797181:0:17048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789597044.797231:0:17048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789597044.797348:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17048:1876527984890880:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789597044.797445:0:17048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597044.797488:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83de6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.797748:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984890880 00000100:00100000:1.0:1789597044.797759:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984890880 00000100:00100000:1.0:1789597044.797834:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789597044.797847:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17048:x1876527984890880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789597044.797969:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17048:x1876527984890880:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597044.797978:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789597044.798123:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17048:1876527984890880:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789597044.798316:0:17048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789597044.798488:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17048:1876527984891008:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789597044.798522:0:17048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597044.798552:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b76000 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.798710:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891008 00000100:00100000:1.0:1789597044.798717:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891008 00000100:00100000:1.0:1789597044.798761:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789597044.798769:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17048:x1876527984891008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789597044.798887:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17048:x1876527984891008:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (363us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789597044.798917:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789597044.799289:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17048:1876527984891008:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789597044.799333:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799343:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799351:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799357:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597044.799361:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799442:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799459:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:3.0:1789597044.799462:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789597044.799467:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799474:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0241 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799509:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799524:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799530:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799535:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597044.799538:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799543:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799552:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:3.0:1789597044.799554:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789597044.799560:0:17048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 19 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799571:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 19 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799579:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 19 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.799643:0:17048:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 19 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597044.799657:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984891136:192.168.202.16@tcp:105: 00000100:00100000:3.0:1789597044.799782:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597044.806157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597044.806256:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744768 00000100:00100000:2.0:1789597044.806269:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744768 00000100:00100000:2.0:1789597044.806340:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789597044.806351:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebf972850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+20:15635:x1876527961744768:12345-192.168.202.16@tcp:49:dd.0 00000100:00100000:2.0:1789597044.806529:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebf972850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+20:15635:x1876527961744768:12345-192.168.202.16@tcp:49:dd.0 Request processed in 179us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597044.806537:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1789597044.814036:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17048:1876527984891136:192.168.202.16@tcp:105: 00010000:00010000:3.0:1789597044.814078:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.814092:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743a00/0x7b5398e289bc0199 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814547:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814565:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814577:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814590:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814607:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814614:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814620:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.814641:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814649:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814662:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:2.0:1789597044.814665:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597044.814669:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814675:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0248 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814719:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814726:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814731:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814736:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597044.814739:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814746:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814754:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:2.0:1789597044.814757:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789597044.814767:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597044.814773:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e80031c00/0x7b5398e289bc023a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597044.814961:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+19:15636:x1876527961744384:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 36393us (36695us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789597044.814973:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000020:00080000:2.0:1789597044.814980:0:17048:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789597044.815623:0:17082:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789597044.815629:0:17082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789597044.815670:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789597044.815708:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789597044.815959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597044.819028:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961744896 00000100:00100000:0.0:1789597044.819052:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961744896 00000100:00100000:0.0:1789597044.819453:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789597044.819464:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+19:15635:x1876527961744896:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789597044.819503:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597044.819528:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc024f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e46 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.819567:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0256 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.819582:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0256 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.819605:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0256 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.819759:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc024f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e46 expref: 21 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.819779:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0256 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e46 expref: 20 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597044.819787:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:0.0:1789597044.819791:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789597044.819794:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4200, rc 0) 00000100:00100000:0.0:1789597044.819857:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+20:15635:x1876527961744896:12345-192.168.202.16@tcp:101:dd.0 Request processed in 395us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597044.819864:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:2.0:1789597044.820517:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597044.832798:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745152 00000100:00100000:1.0:1789597044.832819:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745152 00000100:00100000:1.0:1789597044.832941:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789597044.832951:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+20:15636:x1876527961745152:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789597044.833288:0:17049:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789597044.833325:0:17049:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789597044.833901:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.833927:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.833942:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.833951:0:17049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.833958:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.833965:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597044.833991:0:17049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789597044.835288:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+22:15636:x1876527961745152:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1168us (13607us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789597044.835319:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000020:00080000:1.0:1789597044.835328:0:17049:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789597044.838067:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597044.838089:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.838105:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597044.838110:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.838135:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.838157:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:3.0:1789597044.838160:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789597044.838166:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.838172:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742c00/0x7b5398e289bc025d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597044.840461:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597044.840465:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597044.840469:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597045.052953:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597045.067217:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597045.067271:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.067788:0:18561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745280 00000100:00100000:0.0:1789597045.067802:0:18561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745280 00000100:00100000:0.0:1789597045.067913:0:18561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745408 00000100:00100000:0.0:1789597045.067933:0:18561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745408 00000100:00100000:0.0:1789597045.067959:0:18561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789597045.067970:0:18561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+8:2408:x1876527961745280:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1789597045.068030:0:18561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aab1574, atime: 0x6aab1573, ctime: 0x6aab1574, blocks: 0x0 00010000:00010000:0.0:1789597045.068041:0:18561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.068078:0:18561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=619s v=(0 0) 00010000:00010000:0.0:1789597045.068085:0:18561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597045.068093:0:18561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.068113:0:18561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597045.243249:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243305:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243346:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243401:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243417:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243440:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597045.243475:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745792 00000100:00100000:0.0:1789597045.243489:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745792 00000100:00100000:0.0:1789597045.243568:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746304 00000100:00100000:0.0:1789597045.243571:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746304 00000100:00100000:0.0:1789597045.243601:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746176 00000100:00100000:0.0:1789597045.243604:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746176 00000100:00100000:0.0:1789597045.243655:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789597045.243666:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2406:x1876527961745792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597045.243810:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2406:x1876527961745792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 144us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597045.243818:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789597045.243836:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1789597045.243855:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2406:x1876527961746304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597045.243880:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2406:x1876527961746304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597045.243887:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1789597045.243899:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789597045.243905:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2406:x1876527961746176:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597045.243926:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2406:x1876527961746176:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597045.243931:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00080000:0.0:1789597045.243950:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789597045.243955:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597045.243970:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746048 00000100:00100000:0.0:1789597045.243975:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746048 00000100:00100000:0.0:1789597045.244004:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745664 00000100:00100000:0.0:1789597045.244007:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745664 00000100:00100000:0.0:1789597045.244019:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745920 00000100:00100000:0.0:1789597045.244021:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745920 00000100:00100000:0.0:1789597045.244036:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:0.0:1789597045.244042:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2406:x1876527961746048:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597045.244069:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2406:x1876527961746048:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597045.244082:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:0.0:1789597045.244096:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:0.0:1789597045.244102:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2406:x1876527961745664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597045.244131:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2406:x1876527961745664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597045.244137:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:0.0:1789597045.244148:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:0.0:1789597045.244154:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2406:x1876527961745920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597045.244180:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2406:x1876527961745920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597045.244187:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00080000:0.0:1789597045.244199:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597045.244202:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789597045.245792:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961745536 00000100:00100000:1.0:1789597045.245811:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961745536 00000100:00100000:1.0:1789597045.245894:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:1.0:1789597045.245904:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:2406:x1876527961745536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597045.245976:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:2406:x1876527961745536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 73us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597045.245984:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000001:00080000:2.0:1789597045.256375:0:19371:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1789597045.256399:0:19371:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1789597045.278877:0:18561:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789597045.278893:0:18561:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789597044 -> 1789597045 00002000:00010000:0.0:1789597045.278896:0:18561:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789597044 -> 1789597045 00002000:00010000:0.0:1789597045.278899:0:18561:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1789597045.278923:0:18561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.278938:0:18561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.278949:0:18561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.278987:0:18561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597045.278994:0:18561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.279007:0:18561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.279037:0:18561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.279046:0:18561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a427700/0x7b5398e289bc0264 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597045.279353:0:18561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+6:2408:x1876527961745280:12345-192.168.202.16@tcp:4:dd.0 Request processed in 211376us (212141us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789597045.279434:0:18561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789597045.279474:0:18561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789597045.279490:0:18561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961745408:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1789597045.279534:0:18561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aab1575, atime: 0x6aab1573, ctime: 0x6aab1575, blocks: 0x2000 00010000:00010000:0.0:1789597045.279541:0:18561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.279554:0:18561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789597045.279559:0:18561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597045.279566:0:18561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597045.279598:0:18561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789597045.424571:0:19371:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789597045.424810:0:18561:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789597045.424816:0:18561:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789597045.424834:0:18561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597045.424848:0:18561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597045.424858:0:18561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597045.424866:0:18561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597045.424871:0:18561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597045.424904:0:18561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597045.424927:0:18561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597045.424935:0:18561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089a5dbf0/0x7b5398e289bc026b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597045.425070:0:18561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961745408:12345-192.168.202.16@tcp:4:dd.0 Request processed in 145580us (357792us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789597045.425087:0:18561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00010000:00010000:3.0:1789597046.077487:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597046.204952:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984891264:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.205077:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.205098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984891392:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.205143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.205159:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597046.205168:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984891520:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.205192:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891392 00000100:00100000:2.0:1789597046.205205:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891392 00000100:00100000:3.0:1789597046.205211:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.205256:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891264 00000100:00100000:3.0:1789597046.205259:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891264 00000100:00100000:2.0:1789597046.205266:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789597046.205276:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984891392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.205287:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789597046.205293:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984891264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.205337:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984891264:12345-0@lo:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597046.205337:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984891392:12345-0@lo:400:kworker.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.205345:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789597046.205345:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789597046.205394:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984891264:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.205426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984891776:0@lo:400:kworker.0 00000100:00100000:0.0:1789597046.205517:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891520 00000100:00100000:0.0:1789597046.205521:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891520 00000100:00100000:0.0:1789597046.205579:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789597046.205598:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984891520:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789597046.205700:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597046.205731:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984892032:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.209390:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984891392:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.209436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984891904:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.209513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.209605:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984892416:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.210865:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891904 00000100:00100000:3.0:1789597046.210882:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891904 00000100:00100000:3.0:1789597046.210947:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789597046.210958:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984891904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.211034:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984891904:12345-0@lo:400:kworker.0 Request processed in 78us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.211042:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789597046.211091:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984891648:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.211220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.211269:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984892928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597046.211297:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.211339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984891904:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.211354:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789597046.211360:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984892288:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.211382:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.211401:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984892800:0@lo:400:kworker.0 00000100:00100000:2.0:1789597046.211424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.211457:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892928 00000100:00100000:2.0:1789597046.211462:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892928 00000100:00100000:2.0:1789597046.211503:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789597046.211511:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984892928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789597046.211539:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597046.211758:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.211780:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984892160:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.211804:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.211822:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984892672:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.211842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.211871:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891648 00000100:00100000:3.0:1789597046.211874:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891648 00000100:00100000:3.0:1789597046.211898:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892160 00000100:00100000:3.0:1789597046.211901:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892160 00000100:00100000:3.0:1789597046.211917:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789597046.211923:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984891648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.211959:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984891648:12345-0@lo:400:kworker.0 Request processed in 37us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.211966:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789597046.211980:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789597046.211986:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984892160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.212011:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984892160:12345-0@lo:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.212017:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789597046.212055:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789597046.212061:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7e869bca80, transno 8589934596 00000004:00080000:3.0:1789597046.212073:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789597046.212091:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984891648:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.212103:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984892160:0@lo:400:kworker.0 00000100:00100000:0.0:1789597046.213131:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892416 00000100:00100000:0.0:1789597046.213143:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892416 00000100:00100000:0.0:1789597046.213185:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892288 00000100:00100000:0.0:1789597046.213188:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892288 00000100:00100000:0.0:1789597046.213201:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892800 00000100:00100000:0.0:1789597046.213204:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892800 00000100:00100000:0.0:1789597046.213217:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892672 00000100:00100000:0.0:1789597046.213219:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892672 00000100:00100000:0.0:1789597046.213239:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789597046.213247:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984892416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597046.213321:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984892416:12345-0@lo:400:kworker.0 Request processed in 75us (3680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597046.213328:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789597046.213344:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789597046.213351:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984892288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597046.213410:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984892288:12345-0@lo:400:kworker.0 Request processed in 60us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597046.213417:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789597046.213429:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789597046.213444:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597046.213475:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984892800:12345-0@lo:400:kworker.0 Request processed in 33us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597046.213481:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789597046.213494:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789597046.213500:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984892672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597046.213527:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984892672:12345-0@lo:400:kworker.0 Request processed in 28us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597046.213533:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789597046.213540:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597046.213546:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789597046.213549:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597046.213589:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597046.213589:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984891520:12345-0@lo:400:kworker.0 Request processed in 7983us (8367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597046.213597:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789597046.213610:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892032 00000100:00100000:0.0:1789597046.213613:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892032 00000100:00080000:1.0:1789597046.213806:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597046.213822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984892544:0@lo:400:kworker.0 00000100:00100000:1.0:1789597046.213855:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597046.213941:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984892928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2429us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597046.213949:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789597046.214525:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984892672:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.214556:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984891520:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.214878:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.214947:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984892544 00000100:00100000:3.0:1789597046.214953:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984892544 00000100:00100000:3.0:1789597046.214995:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984891776 00000100:00100000:3.0:1789597046.214999:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984891776 00000100:00100000:3.0:1789597046.215014:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789597046.215021:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984892544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.215081:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984892544:12345-0@lo:400:kworker.0 Request processed in 60us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.215087:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789597046.215101:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789597046.215107:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984891776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.215139:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984891776:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.215144:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789597046.217113:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984892288:0@lo:400:kworker.0 00010000:00080000:3.0:1789597046.217138:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb98d4a80 x1876527984892800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597046.217149:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984892800:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.217161:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984892416:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.220461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984892928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597046.220578:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984891776:0@lo:400:kworker.0 00010000:00080000:3.0:1789597046.220726:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb98d5500 x1876527984892544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597046.220740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984892544:0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.220753:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984893056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789597046.220828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597046.220977:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893056 00000100:00100000:3.0:1789597046.220987:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893056 00000100:00100000:3.0:1789597046.221038:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789597046.221048:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984893056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789597046.221077:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597046.221127:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984893056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.221134:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789597046.223818:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984893056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789597046.223934:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789597046.223964:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984892032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597046.224072:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984892032:12345-0@lo:400:kworker.0 Request processed in 129us (10491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597046.224080:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789597046.225512:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984892032:0@lo:400:kworker.0 00000100:00080000:1.0:1789597046.226303:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789597047.102622:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789597047.743814:0:20227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789597047.744457:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984893184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789597047.744548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597047.744617:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893184 00000100:00100000:0.0:1789597047.744627:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893184 00000100:00100000:0.0:1789597047.744700:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789597047.744711:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984893184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789597047.745225:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597047.745376:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984893184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 667us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597047.745385:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789597047.748388:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984893184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789597048.127948:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597049.150467:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597049.790525:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789597049.790559:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984893312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597049.790636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597049.790728:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893312 00000100:00100000:0.0:1789597049.790743:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893312 00000100:00100000:0.0:1789597049.790807:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789597049.790816:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984893312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597049.790847:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597049.790895:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984893312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597049.790901:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789597049.790922:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597049.790963:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984893312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597049.791441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984893440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597049.791481:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597049.791544:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893440 00000100:00100000:2.0:1789597049.791560:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893440 00000100:00100000:2.0:1789597049.791596:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789597049.791603:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984893440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597049.791629:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597049.791736:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984893568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597049.791765:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597049.791799:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893568 00000100:00100000:0.0:1789597049.791803:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893568 00000100:00100000:0.0:1789597049.791822:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789597049.791829:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984893568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597049.791847:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789597049.791880:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984893568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597049.791887:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789597049.791921:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb98d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984893568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597049.792204:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984893440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 600us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597049.792220:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789597049.792350:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984893440:0@lo:41:osp-pre-1-0.0 Debug log: 43089 lines, 43089 kept, 0 dropped, 0 bad.